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INTRDDUCTIOM 



For the past four years the investigators have been studying the use of 
videotape and audiotape in the clinical training of bpeech and hearing 
clinicians. While each of the first three years has been suoniarized 
individually in separate reports, this report will attempt to draw 
together and suanarize the four individual but related projects. 

The initial project (An experimental Study of the Clinical A cquisition 
of Behavioral Principles by Videotape Self Confrontation ; Project No. 
4071, Grant No. OEG-8«071319-2814) was carried on by Boone and Goldberg 
(1969) and attempted to answer questions pertaining to the following 
three hypotheses: 

"1. Videotape self -confrontation procedures coupled with principles 
of behavioral therapy are feasible and practical methodologies 
for training communication and conmunication disorder specialists; 

2. Self-confrontation procedures differ significantly from more 
traditional training approaches in their effects on the develop- 
ment of clinical skills; 

3. Single and double self-confrontation procedures differ signifi- 
cantly from each other in their effects on the development of 
clinical skills." 

The second project ( The Development of Clinical Skills in Speech Pathology 
by Audiotape and Videotape Self -Confrontation ; Project No. 1381, Grant 
No. OEG-9-071318-2814) was reported by Boone and Stech (1970) relative to 
the following four research questions: 

"1. Are videotape self-confrontation (single and double confronta- 
tion) procedures practical and efficient methods of improving 
the self-awareness of developing speech clinicians? 

2. Does the dissection of therapy segments through self -confronta- 
tion provide the student clinician insights into better use of 
operant methodologies in his therapy as compared to conventional 
methods of developing these skills? 

3. Is audiotape as effective as videotape for studying oneself and 
what one does in therapy? 

4. Can supervisors be trained to employ videotape derived matrices 
developed in the first year of the project and employ them as 
supervisors with student clinicians?" 

The third year project ( Application of Videotape and Audiotape Self- 
Confrontation Procedures to Training Clinicians in Speech and Hearing 
Therapy ; Project No. 1412, Grant No. OEG-0- 70-4758-607. ) consisted 
of a dissemination phase, an application phase, and a research phase. 
Boone and Prescott (1971) summarized this work and reported that they: 



-1- 



!• Organized and conducted a conference in Denver , Colorado , 
entitled, "Videotape and Audiotape Confrontation in Clinical 
Training." The partial aim of that neeting was to diaacninate 
the findings of previous research. 

2m The application phase involved training, cataloguing, and 
utilisation of all confrontation Methodologies developed in 
the previous projects* 

3. The aia of the research phase was toward detemining variables 
that could be used to predict changes resulting fron audi'> 
confrontation and video*audio confrontation utilizing both a 
ten category systes and a video-audio nineteen category systesi. 

Finally the report for the current year of study, an extension of the 
1971 project, vill be incorporated into this report. Application of 
Videotape and Audiotape Self^onfrontation Procedures to Training 
Clinicians in Speech Hearing Therapy, Part II (Project No» 152310, 
Grant Ho« 'OECO- 70-4758 ( 607).) The purpose of this final year was to 
apply and disseminate findings fron previous investigations specific 
to the use of videotape and audiotape confrontation in clinical training. 
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RELATED RESEARCH 



Numerous writers have suggested that beneficial effects such as self* 
insight, ego development, and self*understanding may be the result of 
self-confrontation (Miller, Isaacs, and Haggard, 1965; Freud, 1946; 
Gottschalk and Auerbach, 1966), Confrontation of self-utilizing 
recording devices, audio- and videotape playback, have been employed 
in the training of counselors (Ivey, Normington, Hiller, Morrill, Haase, 
1968; Poling, 1965; V&lz and Johnson, 1963), therapy with mentally ill 
patients (Stoll^r, 1967; Moore, Chervell, and West, 1945; Boyd and 
Sisney, 1967), the teaching of interaction skills (Haines and Eachus, 
1965), as well as the teaching of public speaking (Dieker, Crane, and 
Brown, 1968; McCroskey and Lashbrook, 1968). 

Goldberg (1960) reported that self-evaluation was more likely to be of 
benefit to individuals than external evaluation. Related to Goldberg's 
conclusion was the finding of Dieker, Crane, and Brown (1968) that 
students who actively participated in some form of self analysis during 
the self-confrontation experience on videotape benefitted more from the 
eAperience than students %fho merely viewed themselves passively. 

Research relating to the impact of self-confrontation has been reported 
by several investigators. Holzman and Rousey (1966) reported the 
results of a research study on the voice as a percept. Holzman, Rousey, 
and Snyder (1966) found that subjects listening to their own voices 
showed a greater physiological activation and a constriction in free 
association. Braucht (1968) has shown that the most potent effect of 
videotape confrontation with emotionally disturbed subjects is an 
improvement in self-perception accuracy when accuracy is defined as 
the discrepancy between self-ratings and ratings by others. On the 
basis of observations, tape recordings, and films Nielsen (1962) 
reported that self-confrontation forced subjects to revise self -concepts, 
often causing them to modify behavior. 

Research in the area of verbal conditioning lends support to the 
supposition that behavior can be modified through social reinforcement. 
Extensive reviews of the verbal conditioning literature can be found in 
Greenspoon (1959), Krasner (1958, 1962, and 1965) and4filliams (1954). 

Although television has been used in clinical speech training programs 
(Aronson and Irwin, 1960; Wood, 1965; O'Neill and Peterson, 1964; 
Diedrich, 1966; Clifford, 1968), little if any research has been 
reported dealing with the effects of videotape self-confrontation in 
the preparation of speech clinicians. Although there is little in the 
way of quantitative research in the clinical training area, the speech 
pathology literature contains worthwhile articles on therapeutic pro- 
cedures. (Jakobovitz, 1966), therapy programs (Ruben, et. al., 1967), 
specialized training methods (Holland and Matthews, 1963), and therapy 
processes (Cooper, 1968). In 1967, the entire December issue of Asha 
was devoted to the problem of clinical supervision. In this issue. 
Miner identified general problesM associated with the training of 
therapists in clinical skills; Prather supported client oriented super- 
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vitlon as opposed to clinician oriented supervision, end Kunze recom* 
mended behavioral recordings as an aid in evaluating therapy procedures. 
Kunze fait that unlike impressionistic reactions, behavioral recordings 
can preserve data, allov for the direct compariaon of non^contiguous 
sequences, prevent the distortion that can occur vhen too much emphasis 
is placed on vivid but isolated events, and reduce observer biaa« 

In 1964, Halfond urged those involved in the training of clinicians not 
to downgrade the role of the supervisor. A year later, Van Riper (1965) 
recommended a supervisory system that involves a number of major and 
"vinor conferences between supervisor and trainee* 

An elaborate description of training needs and techniques was provided 
by Hard and Webster (1965a and 1965b). Ward and Webster suggested that 
a trainee's needs and anxieties could inhibit his progress. They stress- 
ed the importance of giving a student clinician insight into his behav- 
ior as a therapist so he can modify his performance and experiment vith 
new behaviors. 

Ingram and SturAmn (1967) conducted one of the few published research 
studies in the clinical training area. The two investigators demon- 
strated that training in speech therapy can result in atatistically 
significant changes in a trainee's responses to such words as: teach- 
ing, rapport, helpful, acceptance, motivation, empathy, feelings, and 
communication. 

In a discussion of behavioral principles and speech therapy, Holland 
(1967) suggested that the success of some clinical techniques can be 
explained in behavioral terms; that is, such principles as reinforce- 
ment and shaping can be viewed as ways of eoiploying behavioral approach- 
es in clinical settings, ''lie present investigation exwined the 
usefulness of behavioral principles in the training of clinicians. 
Instrumental or operant conditioning refers to learning in which the 
organism is reinforced for emitting certain predetermined responses. 
Reinforcement may consist of reward, non- reward, or punishment. In 
those cases where it is desired that the organism emit a particular 
response that it is capable of making but which is not in its behavior 
repertory, reaponae is "shaped" into the repertory. ^ 

Recent application of operant conditioning techniques in ps/chological 
therapy situationa suggests that such techniques provide a powerful 
method for modifying behavior. The origin of these techniques in 
experimental psychology date back to Thomdike'a early work (1911) on 
trial-and-error learning in anlauils. However, the most recent and 
relevant laboratory work in inatrumental. conditioning has been conducted 
by Skinner (1938, 1953, 1961). Working primarily with rats and 
pigeons. Skinner has developed a research environment (the Skinner Box), 
a behavioral unit (response frequency), and a reinforcement system 
which provides the framework for instrumental conditioning (Ferster and 
Skinner, 1957; Skinner, 1938). These techniques have been successful- 
ly applied in the development and use of teaching machines and program- 
mad inatruction (Holland and Skinner, 1961; Skinner, 1954,1958, 1961). 



-4- 



The first contemporary study reporting the use of instrumental condition* 
ing in s therapy setting was published by Skinner, et« al« (1954) iiho 
placed psychotic patients in what aoKninted to a human-sized Skinner Box 
(a room containing vending machine equipment designed and programmed to 
dispense reinforcers such as candy and gum when handles on the machines 
were depressed). Patients who responded by operating the equipment in 
order to gain rewards would, in this manner, be brought back into con- 
tact with their environment. Early findings indicated that high, 
steady response rates could be established in patients who previously 
had shown little inclination to interact with their environment. Sub- 
sequent studies using similar settings have been reported by Ferster and 
D^yer (1962); King, Armitage and Tilton (1960); and Lindsley (1965). 

The cost of vending, recording, and programming equipment in the above 
cited studies was very great* However, subsequent investigators have 
found that effective behavior modification through instrumental 'condi- 
tioning can occur without the use of complex, expensive equipment. 

The literature contains some dranatic examples of instrumental condition- 
ing. Working with two hospitalized psychotics who had been mute for 19 
years and 14 years respectively, Isaacs, Thomas, and Goldiamond (1960) 
were able to reinstate verbal behavior in six weeks by using chewing 
gum as reward reinforcement. One patient was first rewarded for merely 
looking at the gum« next for making lip movements, dien for making 
sounds, and finally for repeating the word "gum". The second was 
originally given gum for joining a therapy group, and finally for 
participating in group interaction. 

Behavior rccord/.ng and classification were included in the previous 
videotape confrontation research at the University of Denver, (Boone 
and Goldberg, 1969; Boone and Stech, 1970; Boone and Prescott, 1971) 
all supported by the Bureau of Education for the Handicapped, Office 
of Eductition. A ten category system was developed (Stech, 1968) and 
was modified by Boone and Prescott (1971)« These systems are used to 
analyze therapy tapes in order to evaluate the sequence of clinician 
and client behaviors. 

The speech therapy behavior category system was developed on the model 
of the interaction analysis systems currently in use in the area of 
teacher training (Amidon and Hough, 1967). Flanders introduced the 
first comprehensive system of recording teacher-pupil interaction 
(Flanders, 1960) although earlier systems had been devised and applied 
(Withall, 1949; Anderson, 1939; Smith, 1960; Aschner, 1959; and Medley 
and Mitzel, 1958). Subsequently Amidon and Hunter (1967) extended and 
refined the system and dubbed it the Verbal Interaction Category Sys- 
tem (Vies) . 

Since the introduction of the Flanders system, numerous studies of 
teacher training and behavior change have been performed (Amidon, 1966; 
Amidon and Flanders, 1961; Amidon and Giammatteo, 1965; Hough and 
Amidon, 1965; Hough and Ober, 1966; Hough and Amidon, 1967; and Lohman, 
Ober, and Hough, 1967). . Almost without exception the research has 
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shorn that ^he feedback of interaction data to a teacher or clinician, 
whether a student teacher or clinician or an in-service experienced 
teacher-clinician, results in behavioral change. Because the category 
system deals vith specific behaviors and because the data matrix shows 
graphically the actual consequence of various teacher-clinician be- 
haviors, the feedback of observed interaction is easily understood by 
the teacher and behavior changes can be made rather easily. 

In summary, the literature indicates that self-confrontation, utilizing 
video- and audiotape, is a powerful device for modifying behavior. 
Previous research shows that beneficial effects are the results of con- 
fronting oneself with one*s own performance or behavior. Previous 
application of these techniques to the training of speech and hearing 
clinicians has been limited. The investigations being summarized in 
this report (Boone and Goldberg, 1969; Boone and Stech, 1970; Boone and 
Prescott, 1971; and Boone and Prescott, 1972) demonstrate the usefulness 
of this procedure for the training of speech and hearing clinicians. 
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REVIEW OF PREVIOUS PROJECT FINDINGS 



1969 Project 

In the initial year of study (Boone and Goldberg, 1969) the following 
research statements were expressed: 

"The experiinental phase of the investigation was designed to deter- 
mine the value in training coanunication disorder specialists in 
VTR self*confrontation feedback methods. The study tested the 
following hypotheses: 

1. Videotape self-confrontation procedures coupled with prin- 
ciples of behavioral conditioning are feasible and practi- 
cal methodologies for training conminication disorder 
specialists* 

2« Self -confrontation procedures differ significantly from 
more traditional training approaches in their effects on 
the development of clinical skills* 

A third hypothesis dealt with double confrontation. Feedback theory 
suggests that if individuals are given information about their past 
performance, they are likely to attempt to reduce the discrepancy in 
the future between their actual and their intended behavior. If this 
is so, the effectiveness of VTR self -confrontation might conceivably 
be enhanced by confronting individuals not only with a playback of 
their past performance but with their own reactions to themselves 
as well. That is, if an individual sees himself seeing himself, he 
could become more aware of the discrepancy between how he behaved 
and how he felt about it, and this greater awareness might facilitate 
the learning or change process. A double self -confrontation proce- 
dure was developed to determine the effects of observing oneself 
observing oneaelf and the following hypothesis was tested: 

3. Single and double self-confrontation procedures differ sig- 
nificantly from each other in their effects on the develop- 
ment of clinicil skills." 

Most of the measuring devices used for studying the above hypotheses 
were developed specifically for the project. The instruments included: 

(a) The Chicago Q->Sort (Dymond and Rogers, 1954) was designed to measure 
changes in self-acceptance. This tool was used to compare control to 
experimental subjects relative to their sorting performance. The Chicago 
Q-Sort may be found in Appendix A. 

(b) The Denver Q-Sort was developed by the project staff and was design- 
ed to show differences between a clinician's perceived actual performance 
and what he considered to be an ideal clinical performance. The Denver 
Q-Sort comproses Appendix B. 



(c) A Self-Perception Questionnaire was developed by the project staff 
in the form of a semantic differential. This measure was used to mea- 
sure a subject's feelings about himself following videotape self confron- 
tation (see Appendix C)« 

(d) A Self -Confrontation Questionnaire was developed to measure the 
subject* s feelings pertaining to his clinical performance following 
self confrontation (see Appendix D)« 

(e) A Double Self-Confrontation Questionnaire was developed and utiliz- 
e to measure the effects of having subjects view themselves viewing 
themselves (see Appendix E). 

(f) A ten category scoring system was developed (Stech, 1969) and 
modified by Boone and Prescott (1971) that allowed each subject to 
categorize each therapy event observed in one of ten ways. A manual 
for utilizing this system, as well as other scoring systems, developed 
by Boone and Prescott (1971) is included in this final report (Appendix 



The findings of th-* first year project, 1969, are summarized below. 

(a) The results obtained from the Q-Sort data indicated that the Chica- 
go Q-Sort was not a sensitive measure of the changes that occurred, for 
the subjects studied, as a result of videotape self-confrontation. The 
Denver Q^Sort proved to be an interesting and worthwhile instrument. 

It was noted that the experimental subjects fended to pteserve the dis- 
tance between their perception of **self as a clinician" and their 
perceived '* ideal" clinician. This preservation of distance between 
"self" and "ideal" was not noted for the control subjects who demon*- 
strated a convergence b^stween their perception of the "self" and "ideal" 
clinician. These results were interpreted to indicate that the self- 
confrontation experience is one that tends to keep an individual 
"reality oriented" in terms of a comparison between actual performance 
and ideal performance. 

(b) The results of the Self-Perception Questionnaire indicated that 
the subjects sttidied did not change their perception of self more under 
double confrontation cor^ditions as compared to single confrontation 
conditions. It was concluded that single confrontation was ineffective 
tool for changing a person's self -perception and that the added expense 
and effort needed to employ double self*confrontation procedures could 
not be justified. 

(c) The Single Self-Confrontation Questionnaire indicated that the 
confrontation experience tended, over time, to result in an elevated 
self-concept relative to the application of clinical procedures and 
behavioral principles. 

(d) The Double Self-Confrontation Questionnaire results were interpret- 
ed by Boone and Goldberg (1969) as folloirs, "...the double self-confron- 
tation was considered less useful than the single confrontation in terms 
of learning to become a therapist...." 
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(e) The results of the scoring matrix analyses indicated that a work- 
able system had been developed. The system was sensitive to changes 
in the therapy sessions over time and was a reliable system. Boone and 
Goldberg (1969) concluded that, **The category system provided a useful 
form of information feedback transformation which allowed the therapist 
to evaluate and change his own behavior.*' One example of the behavior 
change observed, as a result of the self -confrontation experience, 
related to the scheduling of reinforcement by the clinicians studied. 
In general, the clinicians studied used initial positive reinforcement 
schedules and punishmer^ «c' les of approximately 1007. and zero per- 
cent respectively. B > ^e schedules moved dramatically in the 
direction of fifty pe«. as a result of the self-confrontation 
experience. Since the development of this initial matrix, more sensi- 
tive feedback ratios have been developed and used and are included in 
the scoring manual (Boone and Prescott, 1971) in Appendix F. 

Utilizing a rank order correlation technique (Spearman's Rho) Boone and 
Goldoerg (1969) demonstrated that the scoring matrix was a reliable 
tool. Both intra- and inter judge coefficients were above .90. Boone 
and Goldberg suuanarized their findings as follows: 

"All subjects, 20 experimental and 10 control, were tested. on the 
same dependent measures before the project began and after it was 
completed. Ten of the experimental subjects were assigned to a 
single confrontation condition and 10 subjects were assigned to a 
double confrontation condition. In single confrontation, each 
subject waa instructed to use a therapy matrix and to score his 
therapy session as he observed it. Each subject in the double 
confrontation session was videotaped while he observed and scored 
his therapy session^ He then watched himself watching himself. 
The overall results of the investigation indicated that videotape 
confrontation was a powerful clinical training device. Of primary 
value was the development of the therapy matrix scale which pro- 
vides both the trainer and the clinical trainee with a methodology 
for studying the clinical process and determining two persons' 
effects on one another. By use of the therapy matrix it was 
possible for the trainee to study the sequence of therapy events 
and the response effects of both himself and his client. The 
matrix, when used with videotape confrontation, was found to be 
most effective as a clinical training experience." 

1970 Project 

The 1970 project (Boone and Stech, 1970) was aimed toward comparing the 
effects of self-confrontation utilizing audiotape and videotape. The 
followtiig research questions were asked: 

"1. Are videotape self-confrontation (single and double confronta- 
tion) procedures practical and efficient methods of improving 
the self-awareness of developing speech clinicians? 
2. Does the dissection of therapy segments through self-confron- 
tation provide the student clinician insights into better use 



of operant methodologies in his therapy as compared to conven* 

tional methods of developing these skills? 
3, Is audiotape as effective as videotape for studying both one* 

self and what one does in therapy? 
4* Can supervisors be trained to employ videotape derived 

matrices developed in the first year of the project as super* 

visors with student clinicians?** 

The results relative to question one above confirmed the findings of 
the initial project (Boone and Goldberg, 1969) that single confronta- 
tion was indeed a valuable tool to be utilized for training clinicians* 
Double confrontation did not appear to yield different results from 
those obtained from the single confrontation exposure* 

The results pertaining to the acquisition of operant methodologies as a 
result of exposure to self -confrontation (question two) demonstrated 
another aspect of the effectiveness of self- confrontation* All subjects 
were initially given a test containing questions about learning theory, 
behavioral modification, etc* Post testing in this area showed signif- 
icant improvemeii*: revealing increased knowledge of terms such as 
**base rate**, **re:i r>forceroent schedule**, etc* 

A major effort during the 1970 study was to compare audiotape self- 
confrontation to videotape self-confrontation (question three)* A 
comparison was made between audiotape recordings and videotape record- 
ings of therapy sessions by scoring the same session or sessions from 
both types of recording* This analysis indicated that, on the average, 
fifteen to twenty percent of the events contained in therapy sessions 
are nonverbal and consequently are missed from audiotape scoring* 
It is our opinion that audiotape scoring is, however, of great value 
in that it provides the clinician with considerable information rela- 
tive to his clinical performance* Boone and Stech (1970) concluded 
that: 

'^Whenever the audio and video groups were compared on basic change 
measures employed in this study, there were no significant differ- 
ences found between the two groups* Such a finding seems to mean 
two things to the investigators: One, there is much that goes on 
in clinical training that the student in each group experiences 
outside the confrontation experience which contributes to a sig- 
nificant change in his therapy behaviors over time, and two, 
audiotape confrontation can be a most useful device in developing 
in clinicians an awareness of what goes on in their therapy 
sessions* Audiotape has a real place in the self-study of the 
verbal behaviors of a therapy session* Videotape seems to pro- 
vide all that audiotape can, plus the important information rela- 
tive to nonverbal behaviors**' 

Finally, question ntimber four was directed toward use of the procedures 
developed as supervisory tools* It was concluded that the scoring 
system developed was applicable to the supervision process* The scoring 
system was relatively easy to learn and could be used reliably* The 
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investigators further reported that, in their opinion, students could 
utilize self-confrontation and the therapy scoring matrix to benefit 
from self- supervision* Boone and Stech (1970) summarized their findings 
as follows: 

''In sumniary, audiotape and videotape confrontation both were found 
to be effective methodologies to use in the training of speech and 
hearing clinicians* Since the great majority of events within a 
speech therapy session is verbal in type, the audiotape playback 
will enable the clinician during confrontation playback to recog- 
nize the sequence of verbal events within the segment of therapy 
to be analyzed* With videotape confrontation the clinician gets 
the verbal feedback of his clinical session as well as the import- 
ant nonverbal information (gesture, posture, etc*)* By using a 
therapy matrix for scoring one's therapy session on either audio- 
taped or videotaped playback, the student is able to develop 
accurate insights relative to his function as a person and his 
demonstrated capability as a clinician* This method is applicable 
to clinical sessions regardless of their philosophical basis; i*e*, 
operant, nondirective, etc* 

We might we?l add the audiotape recorder as a useful confrontation 
device in training clinicians* Audiotape confrontation further 
provides a useful and needed device for ongoing self -evaluation by 
practicing clinicians* Audiotape recorders are readily available 
to most speech clinicians and thus may be employed at no additional 
cost and with a minimiun of additional time expenditure* Both 
audiotape and videotape confrontation could have important utiliza* 
tion in the training of professional personnel to work with the 
handicapped*" 

1971 Project 

In 1971 Boone and Prescott (1971) continued research in this area with 
three specific aims in mind: 

(a) To disseminate the findings of the previous studies (1969 
and 1970); 

(b) To apply the findings from the previous studies (1969 and 
1970) to the training of speech and hearing clinicians at 
the University of Denver; and 

(c) To study variables that may be used as predictors of change 
relative to three confrontation procedures: audio confron- 
tation, audio-video confrontation ten category system, and 
audio-video confrontation nineteen category system* 

To accomplish the dissemination phase of the 1971 project a conference 
entitled "Videotape and Audiotape Confrontation in Clinical Training" 
was held at the University of Denver* Participants for the conference 
were selected on the basis of interest in the area of discussion as 
demonstrated through work in the area of interest* Each participant 
presented a paper pertaining to his work in the area of interest with 
group reaction and interaction following each formal presentation* 
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A list of the conference participants with a brief overview of each 
presentation is included in the section Dissemination Activities of 
this report. 

Further dissemination activities included the institution of work by 
Drs. Boone and Prescott on an article for publication as well as 
beginning work on a manual for training others to utilize the methodolo- 
gies developed through these studies. Both the completed article and 
manual are included in the appendices of this report. 

The findings and methodologies of these projects were presented either 
jointly or individually by Boone and Prescott to various groups through- 
out the year. The list of presentations Is incorporated into the 1972 
portion of this report. 

?inally» a course was developed and added to the curriculum in the 
Department of Speech Pathology and Audiology at the University of 
Denver entitled ''Seminar: The Clinical Process.'' The course was 
designed to incorporate methodologies, findings and theoretical formu- 
lations based unoa the research projects reported in this manuscript. 

The application ^<ia<>3 of the 1971 project was accomplished by training 
all of the gradu&wc students in the speech pathology program at the 
University of Denver to use and maintain the audiotape and videotape 
equipment and to learn the scorirg systems and data summarization 
procedures. 

In addition, the application phase included the videotaping and cata- 
loguing of speech and hearing therapy sessions for classroom demonstra- 
tion and instruction. 

Finally, the research phase of the 1971 project was aimed at attempting 
to determine predictor variables relative to maximum change resulting 
from audio confrontation, audio- video confrontation ten category 
systam and audio-video confrontation nineteen category system. The 
following is a list of the possible predictor variables that were 
correlated with chany performance on the three confrontation procedures: 

1. Previous clinical experience in clock hours# 

2. Undergraduate grade point, average. 

3. Graduate Record Examination - Verbal score. 

4. Graduate Record Examination - Quantitative score. 

5. Rank as a clinician by four faculty members in speech pathology 
and audiology at the University of Denver. 

6. Orlen'cation Inventory Scale: S scale, I scale, t scale. 

7. Minnesota Multiphasic Personality Inventory: K scale, F scale 
Hs scale, D* scale, Hy scale, Pd scale, Mf scale. Pa scale, 

Pt scale, Sc scale. Ma scale. Si scale, L scale. 

Boone and Prescott (1971) concluded the following relative to the 
predictor variable results: 
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**I£ one wished to predict change for any or all of the types of 
confrontation experiences described in this study the undergraduate 
grade point average can be derived from past records and requires 
no special testing; consequently, it is easily derived from informa- 
tion already available. Utilizing a method described by Downie and 
Heath (1959, p. 146) for averaging correlation coefficients the r*s 
associated with grade point average for each of the confrontation 
conditions studied were averaged. The resulting mean correlation 
was .90. This value suggests that undergraduate grade point 
average is a good index of expected change from any of the confron* 
tation conditions herein described.** 

Prescott Study 1970 

In addition to the three projects previously summarized Prescott (1971) 
completed a doctoral dissertation in a closely related area. The aim 
of the Prescott study was to statistically compare differences in speech 
therapy sessions, as conducted by inexperienced and experienced clini- 
cians doing therapy with patients %iho represented four parameters of 
communication disorder: voice, language, articulation, and prosody. 
To accomplish th^s aim Prescott expanded the previously described ten 
category scoring system to a nineteen category scoring system. The 
results of the Prencott study indicated that the nineteen category 
scoring system could be used reliably (above .90) and that differences 
needed to be explored relative to the sequences of events employed by 
experienced and inexperienced clinicians doing therapy with different 
communication disorder types. The nineteen categories and their 
definitions are included in the training manual incorporated into a 
later section of this report. 

A question was also asked in the Prescott study p utaining to the 
relationship between the nimiber of events at each matrix level and the 
time periods for events at each matrix level. It appeared possible 
that the tabulation of events at each matrix level might overlook 
valuable information about the therapy process relative to the timed 
element of therapy events. For example, two tabulated units in the 
Explain/Describe category could be timed to take thirty seconds and 
fifteen seconds respectively. When these events were tabulated they 
would have equal value even though one was twice that of the other in 
terms of timed duration. Prescott timed each event in the sessions 
studied and correlated the timed duration for each matrix level with 
the tabulated totals for each matrix level. The resulting correlation 
was .9202 and indicated that a high overall relationship existed be- 
tween these values. The summary chapter of the Prescott study is here 
included: 
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CHAPTER V 



SUMMARY 

The review of the literature indicated a need for the development of a 
methodology for objectively describing the speech therapy process. 
Two previous studies attempted to develop category systems for describ- 
in the speech therapy process. Johnson (1969) developed a 40 category 
system for describing speech therapy sessions attempting to categorize 
speech therapy events; however, low inter-Judge reliability coefficients 
appeared to limit the effectiveness of this system for describing speech 
therapy events. A second system was developed by Stech (1968) as a 
part of a study by Boone and Goldberg (1968). This ten category system 
was based on an operant conditioning model, providing a reliable ap- 
proach for therapy categorization with only observed behaviors being 
scored. Personal experience with the system used by Boone and Goldberg 
Indicated that a considerable amount of what may be important informa- 
tion is not obtained by the use of only ten broad categories. It 
appeared logical that a greater number of descriptive categories specific 
to speech therapy vrould yield more precise description of the speech 
therapy process. 

The purpose of this pcu.-fy was: 

1. to develop a behavioral matrix, based on a general operant 
frsme of refarence, that would allow for the quantification 
of behaviors within a clinical speech therapy session; 

2. to examine the reliability of the behavioral matrix developed; 

3. to examine and describe the behavior identified in speech ther- 
apy sessions. 

To accomplish the above stated purpose a 19 category behavioral matrix 
was developed, based generally on an operant model, for describing 
speech therapy sessions that included one clinician and one client. 
The speech therapy sessions studied were conducted by graduate student 
clinicians in speech pathology at the University of Denver. These 
students were grouped relative to the type of communication disorder 
exhibited by the clients they worked with: prosody, voice, articulation, 
and language. From each of these four client subgroups, three student 
clinicians were randomly selected, resulting in a total of 12 subjects. 
Videotape recordings were made of each subject conducting speech therapy 
on a once a week basis for a period of five weeks. In addition to the 
previously described subjects, two faculty members in speech pathology 
at the University of Denver were selected and were considered to be 
"experlenced"clinicians. Videotape recordings were made of one therapy 
session for ^ach of these two subjects. 

The videotape recorded speech therapy sessions were scored utilizing the 
19 category behavioral matrix developed for this study* Each event was 
tinied with a etop watch and the timed values for each behavioral event 
entered on the matrix score sheet in sequence. Twenty minutes of each 
therapy session was scored with the st&rting point for scoring 
randomly selected so as to provide both initial and final 
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portions of the therapy sessions. 



The results of this study indicated that matrix scoring was reliable. 
The in tra<- judge rank-order coefficient of correlation for the timed 
data at each ranked matrix level and the number of events at each 
ranked matrix level was 1.000 (sig. at .01) and .9429 (sig. at .01) 
respectively. Similar coefficients between judges ranged from .9364 
(sig. at .01) to .9788 (sig. at .01) for the timed data and .9334 
(sig. at .01) to .9364 (sig. at .01) for the nimiber of events. 

Rank-order coefficients of correlation were computed between the total 
time periods of events at each ranked matrix level and the total number 
of events at each ranked matrix level. This coefficient for all sub- 
jects combined was .9202 (sig. at .01) and for the individual subjects 
these coefficients ranged from ^7848 (sig. at .01) to .9771 (sig. at 
.01). These data indicated a high relationship between the timed dura* 
tion of events and the nximber of events for the speech therapy sessions 
studied. Therefore, the tabulating of events appears to provide suffi* 
cient descriptive information which can be efficiently obtained. 

The timing of events allowed for parametric statistical comparisons 
to be made between the subjects included in this study at individual 
levels of the behavioral matrix. Analyses of variance measures were 
computed for each of the following matrix categories: EXI^LAIN/DESCRIBE, 
POSITIVE REINFORCER ( SOCIAL- VERBAL) , CORRECT RESPONSE, INCORRECT RESPONSE, 
and INAPPROPRIATE RESPONSE. These five categories accounted for 80.52% 
of the total time periods for all categories combined, and each single 
category accounted for less than 5% of the total time periods for all 
combined categories. These remaining categories were not always used 
by all subjects for all sessions and resulted in blank cells which 
prohibited further analysis. These analyses indicated that significant 
differences existed between the subjects included in this study rela«- 
tive to individual category usage. The locus of these differences was 
determined by application of the Tukey test for significant gap* 
These data indicated that the matrix utilized in this study provided a 
method that could be used to determine statistically the presence or 
absence of differences between clinicians relative to category usage. 
These data further indicate a need, utilizing a larger number of sub* 
jects, for determining the similarities and differences between 
subjects who work with clients exhibiting differing types of communica* 
tion disorders. 

Application of the matrix utilized in this study indicated that base 
rate information specific to the clinical sessions studied could be 
obtained. Positive and negative reinforcement ratios were computed 
and indicated that, for these measures, the subjects included in this 
study were highly variable. The use to be made of information of this 
nature appears to depend upon the individual clinician and/ or superb- 
visor interpretation relative to the application of this objective 
information. 

Two unit sequences of events were observed and these were subdivided 
into sequences resulting in client behaviors and sequences resulting in 
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clinician behaviors. Only sequences that accounted for at least 1% of 
the total number of events were consfdered to make a relevant contribu- 
tion to the sequences of events observed. Consequently, all sequences 
that accounted for less than 1% of the total number of events were not 
identified. Chi square values were computed for all of the response 
and clinician behaviors that contained at least one cell with 1% of the 
total number of events following clinician and/ or client behaviors. 
These results indicated that the behaviors measured were not randomly 
distributed (chi square .01). The use of the behavioral events that 
were utilized by the subjects included in this study. These data 
indicated two unit sequences of events that were unique to the subgroup 
of subjects studied, as well as two unit sequences that were common to 
all of the subgroups studied. These data further suggested a need for 
future research, based on a large number of subjects, relative to the 
value of utilizing individual two unit sequences of behavioral events 
in terms of the differing types of communication disorders described 
in this study. 

It was concluded that the data obtained from this study indicated that 
the matrix developer for this study provided a considerable and varied 
amount of objective descriptive information when applied to speech 
therapy situations. The methodology appeared to be a reliable one and 
yielded considerable information relative to the therapy sessions 
studied such as reinforcement rat.io data, sequence of therapy events 
data, and data pertaining to clinician similarities and differences. 
This matrix method appears to have considerable future value for 
describing the clinical process in speech therapy, for the training of 
clinicians in speech therapy, for providing a method for evaluating 
clinical effectiveness, and for use in clinical research. 

01 sen Study 1972 

A doctoral study was completed by Olsen (1972) which compared sequential 
event differences between clinicians and communication disorder types. 
This study utilizes a computer program that identified two through six 
unit sequences contained in the therapy sessions under study. The pro- 
gram identified the sequence, the relative frequency of occurrence of 
the sequence, and the location of occurrence of each sequr.ice within the 
session. 

In a preliminary finding, Olsen correlated randomly selected five 
minute segments of therapy sessions to whole sessions. These correla- 
tions were all high (above .84) and indicated that five minute samples 
of a session are highly related to entire sessions. This finding 
allows for increased efficiency in employing the methodologies herein 
described because five minute samples can be validly scored, consequent- 
ly resulting in considerable time saving for the scorer. The summary 
chapter of the Olsen study is here included: 
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Chapter 5 



SUMMARY 

A review of the literature showed the need for a direct, objective, and 
simple approach to supervision of student clinicians (O'Neill, 1964; 
Stace and Drexler, 1969; Prescott, 1970). Attempts have been made to 
categorize speech therapy objectively to assist the supervisor In 
determining how well the clinician and client are moving toward thera- 
peutic goals (Stech, 1969a; Johnson, 1969; Prescott, 1970). It was 
determined that the best category system because of the high intra- and 
inter* judge reliability and the fairly large number of categories for 
descriptive data analysis. 

Until this time there had been no study of category systems differen- 
tiating various parameters of speech therapy, or experienced clinicians 
from inexperienced clinicians, to give the supervisor and clinician 
some comparative data. The purposes of this study were: 1) To deter- 
mine category totals and percentages, interaction ratios, and sequential 
patterns of interaction for experienced and Inexperienced clinicians in 
four parameters of speech therapy using the Prescott Nineteen Category 
Scoring System. 2) To determine the relationship between five and 
ten minute random segment of a therapy session and the entire therapy 
session as measured by the Prescott Nineteen Category Scoring System. 

To accomplish the above stated purposes, four parameters of speech 
therapy were chosen for study: 1) articulation disorders, 2) delayed 
language disorders, 3) prosody disorders, and 4) voice disorders. 
Within each parameter three clients were seen by inexperienced clini- 
cians and three were seen by experienced clinicians. Each client/ 
clinician combination was videotaped for ten therapy sessions with 
the experimenter scoring the interactions of each therapy session from 
the vldeoUpe. This meant that in every parameter for experienced 
or inexperienced cllnlclanft a total of 30 therapy sessions were analyzed* 
Experienced clinicians were defined as faculty members of the University 
of Denver Department of Speech Pathology and Audlology or graduate 
students who had worked at least six months in the field and had over 
275 hours of clinical experience. Inexperienced clinicians were defin- 
ed as graduate or undergraduate students who had less than 275 hours 
of clinical experience and had never worked in the field. The clients 
were chosen from the University of Denver Department of Speech Path- 
ology and Audlology roster of those needing therapy. 

Intra-judge and inter-judge reliability were obtained using the Spearman 
Rank Correlation Coefficient. The three intra-judge reliability 
studies were done over a six month period and were .90, .91, and 1.0 
respectively. The inter-judge reliability was .94. 

The results of the study shoved that tl>e Prescott Nineteen Category 
System was useful in determining differences between the four parameters 
of therapy studied and between experienced and inexperienced clinicians 
within any given parameter. Voice clinicians and prosody clinicians 
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appeared to arrange therapy 80 that they received correct responses 
from their clients about 90% of the time while articulation and 
language clinicians arranged for correct responses from their clients 
about 75X of the time. This shoved a meaningful difference In the use 
of the correct responses in therapy. Another category that different* 
tlated the articulation and language clinicians from voice and prosody 
clinicians was the GOOD EVAUJATIVE (TAHGIBLE). With the child clients 
In articulation and language therapy, tnaglble evaluatlves Included 
M6*i's, cereal, and small toys while clinicians with adult clients In 
voice therapy did not use this category often. Within parameters 
there were differences between experienced and Inexperienced clinicians, 
but there were no general trends that could be reported. 

The five and ten minute random segments of therapy were compared to the 
entire therapy session through a Spearman Rank Correlation Coefficient 
for all twelve experienced clinicians to obtain correlations. The 
lowest correlation between a five minute segment and a full therapy 
session was .84 and the highest was .96* The ten minute random samples 
did not yield meaningfully higher correlations. It was concluded that 
the five minute random segisents were representative of the entire 
therapy session. This meant that experimenters and clinicians could 
use five minutes of therapy for evaluation and be confident that their 
results would correlate highly with the scoring of an entire therapy 
session. 

The sequential data analysis of two, three, four, five and six Inter*- 
actions demonstrated differences between experienced and Inexperienced 
clinicians In the same speech parameter. Graphs showed that there were 
Interaction patterns representing at least 5X of the total number of 
Interactions in a therapy session at the four, five, and six levels 
tended to be repetitious of the two and three level Interactions, such 
as 2318142318, where the first numbers were repeated at the end of the 
sequence pattern. There were no unique patterns at the six-level for 
analysis. 

It was felt that the position of patterns In the therapy session might 
be another way of differentiating parameters or experienced clinicians 
from Inexperienced clinicians. It was found that at all of the sequen- 
tial pattern levels where patterns represented at least 51 of the total 
number of Interactions In any therapy session, the patterns tended to 
distribute themselves throughout the therapy session. 

The following Implications were suggested by this study; 

1* The Prescott Nineteen Category Scoring System gives clinicians 
an opportunity to self-evaluate therapy with only a short 
period of training requiring little time out of a busy schedule. 

2. The system gives clinical supervisors objective measures of 
therapeutic comminicatlon that can serve as a basis for dis- 
cussion with the student clinician. Such a system also gives 
the student clinician the opportunity to self-evaluate therapy. 
This would mean that there would be less need for direct super- 
vision except for difficult cases. 
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3. The system also gives the clinical researcher the 'opportunity 
to study the effects of varying the use of certain categories 
such as GOOD EVAUIATIVES on the learning process in c^peech 
therapy. 

4« Modification of the category system to obtain detailed data 
within a given parameter can be accomplished by deleting some 
of the seldom used categories, and adding categories of 
interest, thus yielding information considered pertinent to 
the experimenter. 

Generally, the Prescott Nineteen Category Scoring System showed sensi- 
tivity*«within the therapy sessions studied— to category, ratio, and 
sequential data analyses procedures for showing differences between 
speech parameters and between experienced and inexperienced clinicians* 



Both the Prescott and the Olsen studies demonstrated the utility of 
using a therapy scoring system. The scoring system was found to be an 
effective measure for confronting oneself after therapy, a tool for 
use by the supervisor, and a sensitive device for studying the clinical 
processes of spe^^ch and hearing therapy* 
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CURRENT YEAR PROJECT 



The current year project was entitled "The Application of Videotape and 
Audiotape Confrontation Procedures for Training Clinicians In Speech 
and Hearing Therapy*' and was a continuation of the previous project year, 
(Boone and Prescott, 1971) • The purpose of the current year project 
was, "to apply and disseminate findings from previous Investigations 
specific to the use of videotape and audiotape confrontation In clinical 
training.*' 

Methods and FlndlnRS 

To accomplish the application phase of the project the authors developed 
a workbook entitled, Speech and Hearing Therapy Scoring Manual » that 
described and detailed the various confrontation methodologies In clini- 
cal training. These methodologies were then applied with the clinical 
trainees at the University of Denver. In addition, the methodologies 
were utilized by clinicians In the field In various professional settings 
In and around the Denver area. A copy of the training manual. Speech 
and Hearing Therapy Scoring Manual , may be found In Appendix F. 

Dissemination 

To accomplls^^i the dissemination phase of the project two major types of 
activities were carried on. They Involved presentations by the project 
director and project coordinator and mailing of project publications to 
those who requested them. The authors attempted to disseminate the 
findings and methodologies through th^ presentation of workshops, lec- 
tures, short courses, and convention presentations throughout the 
country. A list of the locations and the type of these activities 
follows. 

Dissemination Activities 1970«7l 

1. In October of 1970 a conference was held at the University of Denver 
entitled '^Videotape and Audiotape Confrontation In Clinical Training.*' 
Participants for the conference were selected on the basis of demonstra- 
tion of current work In the area of Interest. Each participant at the 
conference gave an oral presentation to the participants, followed by 
group reaction and Interaction. Below ^s a list of the names and 
locations of each participant with a brief abstract of his conference 
presentation. 

Daniel R. Boone, An Introduction to Using Video- 

University of Denver tape and Audiotape In the train- 

ing of Speech and Hearing 
Clinicians 

A brief overview Is given to the traditional employment of video and 
audiotape recording devices In clinical training. The recent devel- 
opment of analyses and confrontation devices using these Instruments 
Is specific as the study topic of the Institute. 
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Thomas £• ?re8cott, 
University of Denver 



A Historical Overview of Video- 
tape and Audiotape Confrontation 



A review of Previous research in both videotape and audiotape 
self- confrontation is given. Previous confrontation work by 
counselors, trainers, conomnication methodologists, psychologists, 
and microteaching specialists is related to the ongoing work of 
Prescott and his colleagues in speech and hearing. 

Ernest L Stech, A Cybernetic Model of Video- 

Western Michigan University tape /Audiotape Training for 

Clinical Skills 



Videotape/Audiotape confrontation is described as a feedback 
process. After a baaic introduction to feedback systems, the 
author presents a concept of higher-order feedback loops. Stech 
suggests ways of incorporating permanently in the clinical situa- 
tion high level feedback systems both in clinical training and 
supervision. 

Thomas S. Johnson, Development of a Multidimension- 

Utah State University «1 Scoring System for Observing 

the Clinical Process 



A 40 category system has been experimentally developed %ii\ich may 
be used for content and sequence analyses of speech and hearing 
therapy sessions. This system has developed a graded scoring 
system which permits the exact specification of both patient and 
clinician behaviors in therapy. Intra- and inter-judge reliability 
data is presented along with specifics of matrix validity, all 
indicating the 40 category system to be a valuable tool in studying 
speech and hearing therapy. 

William M. Diedrich, Application of the Multidimen- 

University of Kansas- sional Scoring System in 

School of Medicine Studying the Clinical Process 

in Speech Pathology 

Procedures using the multidimensional clinical process scoring 
system are specified for the training of clinical students. Not 
only can the student study the therapy of someone else in depth, 
but he can develop an appreciation of the total clinical process. 
The student clinician by using such a scoring system can make a 
thorough study of his own therapy, determining the relative 
effectiveness of his own clinical behaviors. 

Thomas E. Prescott, Two Systems for Describing the 

University of Denver Clinical Process 

Two category systems used for describing the clinical process in 
speech pathology are presented. A Ten Category System, as 
developed by Stech, includes five behavioral categories acted out 
by the clinician and five categories nhich specify client behavior. 
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Prescott expands the basic ten category matrix to include 19 cate- 
gories which specify type of stinulus response modality, an 

Important specification in speech and hearing therapy. 



Both videotape and audiotape confrontation, when used with some 
kind of measuring instrument, have vital effects in the clinical 
training of speech pathologists and audiologists« Using confron- 
tation systems of analysis permit the detailed study of the total 
clinical process. The positive effects of confrontation on self- 
concept are presented. Lastly, emphasis is given to using the ten 
or nineteen category systems in therapy supervision, either by a 
supervisor or by self. 

Alvin A. Goldberg, Self-Concept and Change Utiliz- 

University of Denver ing Videotape Self-Confrontation 

Videotape self-confrontation studies generally have found that 
passive viewing, not knowing what to look for, provides for less 
powerful confrontation experience. Observations and problems 
related to positive and negative feedback are presented. "Legiti- 
macy of feedback (that it be valid and not false) appears to be a 
more powerful confrontation aspect than whether or not the feed- 
back is positive or negative. 

Linda A. Ramsey, Application of Category Systems 



The study of group speech therapy in the schools is facilitated 
by applying category analyses. A description is given of procedures 
for videotaping speech clinicians working in the schools with 
therapy groups. Confrontation methods used by both clinician 
and supervisor have worked effectivelyt illustrating the practi- 
cality of videotape confrontation for clinicians and teachers in 
school settings. 

Clyde L. Rousey, Effects of Audiotape Confront 

The Menninger f mindation, tat ion 

Topeka, Kansas 

Affective re^ctiona to self*confrontation via audiotape recordings 
are analyzed and reported. The effects on both clinicians and 
clients in hearing their own voices are discussed from both theo- 
retical and practical viewpoints. While focus is on audiotape 
confrontation In speech and hearing therapy, psychological and 
psychiatric implications of such confrontation are presented. 



Daniel R. Boone, 
University of Denver 



Videotape and Audiotape Con- 
frontation in Clinical Training 



Alachua County Schools, 
Florida 



to the Analysis of Group Therapy 
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Susan T. Mulhern, 
Northwestern University 



The Use of Videotape in Clinical 
Training 



Videotape as a classroom teaching aid is used for demonstration of 
clinical problems, demonstration of test administration and therapy 
techniques. By using category analysis systems, the university 
speech clinic has been exposing graduate clinicians to both self- 
evaluation and supervision evaluation. Practical descriptions are 
given for employing videotape in many aspects of clinical teaching. 



2- Thr tindings and methodologies contained in this and past research 
proje;ti* were presented to various groups either jointly or individually 
by Boone and Prescott, 1970-71. A list of these presentations follows: 



July, 1970 



November, 1970 



November, 1970 



December, 1970 



University of Indiana, participated in 
Public School Supervisory Conference, 
presenting our category systems for therapy 
analyses. 

American Speech and Hearing Association 
Convention, paper presented entitled, 
"A Methodology for Describing Speech and 
Hearing Therapy." 

Lakewood Public School Therapists Inservice 
Training, Lakewood, Colorado. Training was 
given in utilization of project developed 
methodologies. 

Florida State Department of Education, 
Winter Park, Florida, presenting the 
category system to 70 public school speech 
hearing clinicians. 



March, 1971 



March, 1971 



University of Iowa, Iowa City, Iowa, 
Distinguished Lecturer (Boone), Therapy 
Scoring. 

Mid Town Hospital Association, Denver, 
Colorado, Videotape and Audiotape Method- 
ologies presented to therapists in 
occupational therapy, physical therapy, 
and speech pathology. 



March, 1971 



Spalding Rehabilitation Center Inservice 
Training, Denver, Colorado. Description 
and training in utilization of project 
developed methodologies. 
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March, 1971 



May, 1971 



May, 1971 



May, 1971 



Executive Training Corporation, Denver, 
Colorado, Application of category system 
analysis to managerial training. Bureau of 
Land Management* 

Children's Hospital, Denver, Colorado, 
Inservice Training to Speech Pathology 
and Audiology Staff* 

Colorado State University, Fort Collins, 
Colorado, Presented the therapy analysis 
to staff and students* 

Executive Training Corporation, Application 
of category system analysis to managerial 
training, Lakewood Police Department, 
Lakewood, Colorado* 



Dissemination Activities 1971-72 



1* The previously described Speech and Hearing Therapy Scoring Manual , 
(Boone and Prescott, 1971) was dissaalnated to all persons who requested 
it as well as to all participants at workshops and lectures presented by 
Boone and Prescott throughout the year* The following is a list of pre- 
sentations made either Jointly or Individually by Boone and Prescott 
during the current recording period, 1971*72: 



July, 1971 



July, 1971 



September, 1971 



September, 1971 



October, 1971 



October, 1971 



University of Colorado Medical Center 
Denver, Colorado 

'^Speech and Hearing Therapy Scoring'* 

University of. Kansas Medical Center 
Kansas City, Kansas 
"The Therapy Process'* 

Birmingham VA Hospital 
Birmingham, Alabama 
^'Scoring of Therapy 

Speech and Hearing Association 

of Alberta (Canada) 

Banff, Canada 

"The Processes of Therapy'* 

Purdue University, Speech Pathology and 

Audiology 

Lafayette, Indiana 

^'Scoring of Speech and Hearing Therapy** 

University of Washington 
Speech Pathology and Audiology 
Seattle, Washington 
**Procesaes of Therapy** 
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October, 1971 



October, 1971 



November, 1971 



November, 1971 



December, 1971 



January, 1972 



January, 1972 



February, 1972 



February, 1972 



March, 1972 



Washington-Oregon Speech and Hearing 
Associations Combined Meeting 
Seattle, Washington 

''Scoring of Speech and Hearing Therapy** 

Arizona Speech and Hearing Association 
Casa Grande, Arizona 

**The Scoring of Speech and Hearing Therapy" 

Lincoln State School 
Lincoln, Illinois 

**The Training of Mental Health Personnel in 
the State of Illinois in Audio- and Video- 
tape Confrontation Procedures** 

American Speech and Heating Association 

Convention 

Chicago, Illinois 

**Short Course: Videotape and Audiotape 
Confrontation in Clinical Supervision** 

While teaching voice disorders at the 
University of Hawaii, Dr. Boone spent 
one afternoon teaching the scoring system 
to faculty and graduate students in speech 
pathology and audiology. 

Supervisors of Public Schools, 
Southern Minnesota 

Mankato State College, Mankato, Minnesota 
**Processe8 and Scoring of Speech and 
Hearing Therapy** 

Staff and Students, Speech Pathology 
Program Elmira College 
Elmira, New York 

**Self«Confrontation in Speech Pathology" 

Eastern Washington State College 
Cheney, Washington 

**A Workshop on the Processes and Scoring 
in Therapy** 

Special School District of St* Louis 
St. Louis, Missouri 

**A Workshop on the Scoring of Therapy** 

Oklahoma Speech and Hearing Association 
Oklahoma State University 
Stillwater, Oklahoma 
**The Processes and Scoring of Therapy** 
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March, 1972 



March, 1972 



March, 1972 



April, 1972 



May, 1972 



May, 1972 



May, 1972 



June, 1972 



June, 1972 



July, 1972 



Nebraska Speech and Hearing Association 

Omaha, Nebraska 

"The Scoring of Therapy'' 

Denver Area Academy of Private Practition- 
ers of Speech Pathology and Audiology 
University of Denver 
Denver, Colorado 

**The Scoring of Speech and Hearing Therapy" 

Michigan Public School Supervisors and 
Eastern Michigan and Michigan University 
Supervisors 
Ypsilanti, Michigan 

"The Scoring of Therapy" 

Pennsylvania Speech and Hearing Association, 
Pittsburg Hilton, Pittsburg, Pennsylvania 
"A Workshop on Therapy Scoring" 

Kearney State College Faculty and Area 
Public School Supervisors 
Kearney, Nebraska 

"The Scoring of Speech and Hearing Therapy" 

Indiana Speech and Hearing Association 
Muncie, Indiana 

"Self-Accountability in Speech and Hearing 
Therapy" 

California State Department of Public 
Instruction 

Los Angeles Hilton Hotel, Los Angeles, 
California 

Voice Workshop: "The Scoring of Speech and 
Hearing Therapy" 

Baylor Medical Center 
Houston, Texas 

In a Voice Disorders Workshop a lecture was 
presented, "Therapy Scoring" 

Phillips University 
Enid, Okiahona 

A one-day workshop on "Therapy Scoring" 
for the faculties of Tulsa University, 
Oklahonn State University and Phillips 
University* 

University of Pacific 

Stockton, California 

Voice workshop: "Scoring of Therapy" 
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At each of these presentations the authors utilized and presented to the 
participants copies of the Speech and Hearing Therapy Scoring M anual 
(Boone and Prescott, 1971) • These activities have resulted in*"consider* 
able nationwide application of the theoretical and methodological 
information developed in the projects described in the manuscript. 

2. In addition to the above listed presentations an article entitled, 
"Content and Sequence Analysis of Speech and Hearing Therapy" was pub- 
lished in Asha by Boone and Prescott (1972). A reprint of this Asha 
article may be found in Appendix G. Requests for reprints of this 
article have been numerous as have been requests for copies of the 
Speech and Hearing Therapy Scoring Manual . As part of the dissemination 
activities of this project an attempt was made to supply either manuals 
or article reprints to as many of the requestors as possible. This 
through^the-mails dissemination was carried on until the supply of mater- 
ials was exhausted. The supply of materials for dissemination included 
500 Asha reprints and 500 copies of the Speech and Hearing Therapy 
Scoring Manxial . The following is a list of individuals, an<* cities, 
to whom project publications, including manuals and reprints, were sent. 



Date 


Name 


Place 


September, 1970 


Mrs. Nina Ransom 


Titusville, Florida 


October, 1970 


Clare M. Nichols 


West Palm Beach, Florida 


October, 1970 


Kenyon D. Wilson 


Allison, Iowa 


November, 1970 


Mrs. Julie Cunningham 


Iowa City, Iowa 


December, 1970 


Douglas M. Wing 


Great Falls, Montana 


March, 1971 


Dr. Patrick J. Carney 


Iowa City, Iowa 


April, 1971 


Candyce Shaw 


Lincoln, Nebraska 


November, 1971 


Carol Stover 


Chicago, Illinois 


November, 1971 


Karen M. Shay 


Owatonna, Minnesota 


January, 1972 


Dr. Carl Binnie 


Lafayette, Indiana 


January, 1972 


Lyle McFarling 


Mankato, Minnesota 


January, 1972 


Alineda Kudberg 


N. Mankato, Minnesota 


January, 1972 


Fred L« Aden 


Mankato, Minnesota 


January, 1972 


Mrs. S Marxheimer 


Edmonton, Alberta 


January, 1972 


Dr. Thayne Hedges 


Enid, Oklahoma 


January, 1972 


Lois Heusinkveld 


Minneapolis, Minnesota 



-27- 



Pate 




r e Druar y , l v / Z 


reoruary, 19 /Z 


February, 19 7Z 


February, 19 72 


February, 1972 


February, 19/2 


February, 1972 


February, 1972 


February, 1972 


February, 1972 


February, 1972 


February, 1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 


March, 


1972 



Name 

Dr« William Dledrlch 
Dr« Jerry Punch 
Z. Crouch 
Julie C* Lupoid 
Geraldine Chapey 
Alice Stoket 
George V. Schubert 
M* Joseph Whalen 
George V. Schubert 
Charles L* Madison 
Dr« Patricia Hahn 
Mrs* Allen W* Stokes 
Lucille Samartin 
Dr« Fred £• Stanton 
Linda S« Spencer 
Barbara Jane Giles 
Orpha L. Powell 
Kay Hef lin 
Mrs. Becky A. Williams 
Barbara Freed 
Mary Ann Lively 
Mary £• Dobson 
Mary Ann Overall 
Linda Elliott 
Mrs« Mary Aldridge 



Place 

Kansas City, Kansas 
University, Mississippi 
Overland Park, Kansas 
Elkhart, Indiana 
Brooklyn, New York 
Logan,Utah 
Seattle, Washington 
Colville, Washington 
Seattle, Washington 
Pullman, Washington 
Cheney, Washington 
Logan, Utah 
Stillwater, Oklahoma 
Spokane, Washington 
Oklahoma City, Oklahoma 
Edmond, Oklahoma 
Stillwater, Oklahoma 
Tulsa, Oklahoma 

Shawnee, Oklahoma 
Lookeba, Oklahoma 
Oklahoma City, Oklahoma 
Stillwater, Oklahoma 
Sand Springs, Oklahoma 
Shawnee, Oklahoma 
Gushing, Oklahoma 
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Date 




Name 


Place 


March, 


1972 


Eleanor Rowan 


Oklahoma City, Oklahoma 


March, 


1972 


Karen Hibbets 


Enid , Oklahoma 


March. 


1972 


Dr« Burchard M« Carr 


S til Iwater , Oklahoma 


March. 


1972 


Geraldine Dm ChaDev 


Brooklyn, New York 


March, 


1972 


p. Miller 


Fullerton, California 


March, 


1972 


Dr* Elwood G« Anderson 


Alpena, Michigan 


March, 


1972 


Michael Sweet 


Omaha, Nebraska 


March, 


1972 


Mrs* Paul Weber 


Rose , Nebraska 


March, 


1972 


Donald T« Legacie 


Holdrege, Nebraska 


March, 


1972 


Ben Koperski 


Lincoln, Nebraska 


March, 


1972 


Penny Sullivan 


Lincoln, Nebraska 


March, 


1972 


Mrs* Mary Beland 


Lincoln, Nebraska 


March, 


1972 


Blair Wasson 


Grants Pass, Oregon 


March, 


1972 


Dr* Mary Pannb acker 


Denton, Texas 


March, 


1972 


Lon Emerick 


Marquette, Michigan 


April, 


1972 


Mrs* J* Un* Lybarger 


Indianapol is , Indiana 


April, 


1972 


Dr* David Palmer 


Ypsilanti, Michigan 


Aoril 


1972 


Mary Ann Henry 


Greensburg, Pennsylvania 


Aoril 


1972 


Janet Kenyherz 


Pittsburg, Pennsylvania 


April, 


1972 


Miss Mary Alice Hunter 


Lancaster, Pennsylvania 


April, 


1972 


Linda Vogel 


Thermopolis, Wyoming 


April, 


1972 


Dr* George Allen 


California, Pennsylvania 


April, 


1972 


Mrs* Dureta Sexton 


Muncie, Indiana 


April, 


1972 


Mary Jane Myers 


Ebensburg, Pennsylvania 


April, 


1972 


Marvin Robert Kolodny 


Indianapolis 9 Indiana 
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April, 


1972 


Marlene R. Anyder 


Chicoia, Pennsylvania 


April, 


1972 


Ruth L. Myrick 


Levittown, Pennsylvania 


April, 


1972 


Neil E. Carpenter 


Valparaiso, Indiana 


April, 


1972 


Robert T. Lyon 


Willionsport, Pennsylvania 


April, 


1972 


Glenn T. Farling 


Muncie, Indiana 


April, 


1972 


Sue Ehlmann 


Indianapolis, Indiana 


April, 


1972 


Deborah R. Klevans 


University Park, Pennsylvai 


April, 


1972 


Loren Bower 


Villiamsport, Pennsylvania 


April, 


1972 


Sibyl Gholson 


Austin, Texas 


April, 


1972 


Lyim H. Swingle 


West Chester, Pennsylvania 


April, 


1972 


Miss Frances Pulford 


Pittsburg, Pennsylvania 


April, 


1972 


Miss Susan Maxwell 


West Chester, Pennsylvania 


April, 


1972 


Dr. James D. Bryden 


Blooosburg, Pennsylvania 


April, 


1972 


Leanne Ueller 


Muncie, Indiana 


April, 


1972 


Mrs. Fred Hitz 


Muncie, Indiana 


April, 


1972 


Beth A.Ualker 


Huntingdon, Pennsylvania 


April, 1972 


John T. Dellegrotto 


Berwick, Pennsylvania 


April, 


1972 


Dr. Susan L. Gilmore 


Baton Rouge, Lousiana 


April, 


1972 


Dr. Jeannette K. Laguaite New Orleans, Louisana 


April, 


1972 


Sharon, Weintrob 


Philadelphia, Pennsylvania 


April, 


1972 


Laurie Robinson 


West Chester, Pennsylvania 


April, 


1972 


Miss Colleen Han«y 


Canonsburg, Pennsylvania 


April, 


1972 


Cindy Shaffer 


Willismson, West Virginia 


April, 1972 


Dr. Dorothy Bell 


Fort Worth, Texas 


April, 


1972 


Francis Freidline 


Peru, Indiana 
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Date 




Name 


Place 


April 


L, 1972 


Dr, Gerald A, Leidy 


Shippensburg, Pennsylvania 


April 


L, 1972 


Mrs. Mary Palmer 


Levittovn, Pennsylvania 


April 


L, 1972 


Dr, Margaret C. Lefevre Bloomsburg^ Pennsylvania 


April 


L, 1972 


Mrs* Jo Ann Coatsworth 


California, Pennsylvania 


April 


L, 1972 


John R. Clark 


Quakertown, Pennsylvania 


April 


L, 1972 


Mrs, Melinda A. Graham 


Wilkes-Barre, Pennsylvania 


April 


L, 1972 


Dr« Sylvia Greenbarg 


Pittsburg, ' Pennsylvania 


April 


L, 1972 


Heather Stewart 


Wexford, Pennsylvania 


April 


L, 1972 


Miss Eva Glevanik 


Irwin, Pennsylvania 


April 


L, 1972 


Anne Flaherty 


Boston, McKeesport, Pennsylvania 


April 


L, 1972 


Thomas J* Wyse, Jr. 


Indiana, Pennsylvania 


April 


L, 1972 


Helen B. Volz 


University Park, Pennsylvania 


April 


L, 1972 


Jane W. Stoddard 


East Stroudsburg, Pennsylvania 


April 


L, 1972 


Jean Glavich 


Vandling, Pennsylvania 


April 


L, 1972 


M.Terry Ruber 


Hollidaysburg, Pennsylvania 


Apri] 


L, 1972 


Alton A. Pellman 


Annville, Pennsylvania 


Apri] 


L, 1972 


Roseann McMullen 


Cresson, Pennsylvania 


Apri] 


L, 1972 


Francine Tishman 


Conemaugh, Pennsylvania 


April 


L, 1972 


Cynthia Cronk 


Conemaugh, Pennsylvania 


April 


L, 1972 


Edmund C. Nuttall 


Norman, Oklahoma 


May, 


19 7Z 


Julie Carius 


Allentown, Pennsylvania 


May, 


1972 


Bertram J. Hilbert 


Allentom, Pennsylvania 


May, 


1972 


Sandra Thornton 


Williansport, Pennsylvania 


May, 


1972 


Mrs. Ruth Arnold 


Laramie, Uyoming 


May, 


1972 


Margaret R. Rail 


Terre Haute, Indiana 
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Date 




Name 


Place 


May, 


1972 


Mre. Patricia Querry Carlisle, Penneylvania 


May, 


1972 


Miss Janet Ponorski 


Erie, Pennsylvania 


May, 


1972 


Mary M. Grimes 


Catawissa, Pennsylvania 


May, 


1972 


Mrs. Donna Raforth 


Ethete, Wyoming 


May, 


1972 


Ellen R. Bell 


Indianapolis, Indiana 


May, 


1972 


Francis J. Chopko 


Scranton, Pennsylvania 


May, 


1972 


Chauncey J. Hunker 


Gary, Indiana 


May, 


1972 


Miss Jo Carol Hudgins 


Muncie, Indiana 


May, 


1972 


Mary Ann Sobadish 


Sawyersville, Pennsylvania 


May, 


1972 


Kathryn P. Vaurio 


Media, Pennsylvania 


May, 


1972 


Saundra Mikita 


McKeesport, Pennsylvania 


May, 


1972 


Mrs* Lee Ann Shields 


Evansville, Indiana 


May, 


1972 


Carl U. Cannichael 


Haxtun, Colorado 


May, 


1972 


Dr. Jack D. Anderson 


Tulsa, Oklahoma 


May, 


1972 


Lorraine H« Russell 


Philadelphia, Pennsylvania 


May, 


1972 


Miss Christine S. Mclntyre Carlisle, Pennsylvania 


May, 


1972 


Cayle L« Roosevelt 


Jackson, Wyoming 


May, 


1972 


Sally Ramsmeyer 


KokODO, Indiana 


May, 


1972 


Dr. Dale H. Kitchen 


Northville, Michigan 


May, 


1972 


Marty Mornings tar 


Muncie, Indiana 


June, 


1972 


Pat Castells 


Pittsburg, Pennsylvania 


June^ 


1972 


Mrs. K. De Groff 


W. Lafayette, Indiana 


June, 


1972 


Robert A. Hull, Jr. 


Polk, Pennsylvania 


June, 


1972 


Phyllis Homey 


Warsaw, Indiana 


June, 


1972 


James H. Rue 


Donora, Pennsylvania 
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Pate 




Name 


Place 


July, 


1972 


Dr. £• Ruth Walker 


University, Alabama 


July, 


1972 


Dr« Ruth Pearce 


North Hollywood, California 


July, 


1972 


Dr. Joan Dickeraon 


Coeur d^Alene, Idaho 


July, 


1972 


Mr, Arthur Moreau 


Peoria, Illinois 


July, 


1972 


Mrs, Flottnia Taylor 


Lexington, Kentucky 


July, 


1972 


Mrs, Shirley Caratensen Medford, Oregon 


July, 


1972 


Sharon Ferguson 


Munc ie , Indiana 



Application Phase 1972 

Two major activities aimed toward application of the methologies describ- 
ed herein were carried on. First, all of the graduate student speech and 
hearing therapy trainees at the University of Denver, Denver, Colorado, 
were trained to employ all of the scoring techniques and utilized these 
techniques to analyze their therapy during the past year. Second, a 
part of each presentation made individually or jointly by Drs, Boone 
and Prescott included the urging of the listeners to employ the methods 
and techniques described in theit own settings. Numerous letters were 
received indicating a widespread use of these methods and techniques 
throughout the country. It was concluded that both the dissemination 
and application phases had been successfully completed. 
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SUMMARY 



It was hoped in the beginning of these investigations that the study of 
the processes of speech and hearing therapy would lead to new refinements 
in clinical training. Initial study attempts were made to expose stu- 
dents in training to confront theMelves in videotape to make these 
confrontations more meaningful, scoring matrices were devised to help 
the student and his supervisor become awart of therapy interactions. 
Initial focus was in helping the student learn principles of behavioral 
therapy through his direct confrontation of self. Videotape confronts* 
tion, when coupled with the scoring of therapy, was found to have 
significant and powerful effects in training speech and hearing clini- . 
cians. 

It was later found that audiotape was similarly effective as videotape. 
Although in studying oneself in therapy by audiotape the clinician 
loses about 20% of the therapy events (which are wholly visual). Prac- 
tical methodologies were developed for using both audiotape and video- 
tape in confrontation* Scoring systems (individual ten category, group 
ten category, individual 19 category) were developed which yielded 
quantitative data about therapy relative to clinician-client talk time, 
client success rate, clinician reinforcement types and achedules, 
socialization percentage of therapy, control of client, etc. 

The therapy scoring systems have been presented in workshops to several 
thousand speech and hearing clinicians. Clinicians in training, speech 
and hearing clinicians in schools and hospitals have been taught methods 
of confrontation and self-scoring* The new national focus in educational 
and therapeutic accountability has made this self-analysis system very 
relevant to the field of speech pathology and audiology. Consequently, 
the investigators have had nxmerous opportunities to speak before state 
educational groups, training programs, and state-national association 
meetings. The confrontation and scoring methodologies developed in this 
project are being used in numerous settings, both as clinical and re* 
search tools. Although the scoring manual and related reprints have 
been widely disseminated, the investigators are now planning a therapy 
accountability book which will report collectively the many projects 
and methodologies which have emanated from this confrontation project. 
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APPENDICES 



CHICAGO Q-SORT ITEMS 



Appendix A 



!• I feel uncomfortable %riiile talking with someone 

2* I put on a false front 

3* I am a competetive person 

4, I make strong demands on myself 

5* I often kick myself for the things I do 

6* I often feel humiliated 

7* I doubt my sexual powers 

8* I am much like the opposite sex 

9* I have a warm emotional relationship with others 

10* I am aw aloof reserved person 

11* I am responsible for my troubles 

12* I am a responsible person 

13* I have a feeling of hopelessness 

14* I live largely by other peoples values and standards 

15* I can accept most social values and standards 

16* I have few values and standards of my own 

17* I have a hard time controlling my sexual desires 

18* It is difficult to control my aggression 

19* Self control is no problem to me 

20* I am often down in the dumps 

21* I am really self-centered 

22* I usually like people 

23* I express my emotions freely 

24* Usually in a mob of people I feel a little bit alone 

25* I want to give up trying to cope with the world 

26* I can live confortably with the people around me 

27* My hardest battles are with myself 

28* I tend to be on my guard with people who appear more friendly than 

expected 

29* I am optimistic 

30* I am just sort of stubborn 

31* I am critical of people 

32* I usually feel driven 

33* I am liked by most people who know me 

34* I have an underlying feeling that I am not contributing enough to 
life 

35* I am sexually attractive 

36* I feel helpless 

37* I can usually make up my mind and stick to it 

38* My decisions are not my own 

39* I often feel guilty 

40* I am a hostile person 

41* I am contented 

42* I am disorganized 

43* I feel apathetic 

44* I am poised 

45* I just have to drive myself to get things done 

46* I often feel resentful 

47* I am impulsive 
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Appendix A 



48. It is important for me to know how I seem to others 

49* I don't trust my emotions 

50* It is pretty tough to be me 

51* I am a rational person 

52. I have the feeling I am just not facing things 

53* I am tolerant 

54. I try not to think about my problems 

55* I have an attractive personality 

56* I am shy 

57 • I need somebody else to push me through on things 

58* I feel inferior 

59* I am no one* Nothing really seems to be me 

60» I am afraid of what other people think about me 

61* I am ambitious 

62* I despise myse]^ 

63* I have initiative 

64* I shrink from facing a crisis of difficulty 

65* I just don't respect myself 

66* I am a dominant person 

67» I take a positive attitude toward myself 

68* I am assertive 

69 • I am afraid of a full-fledged disagreement with a person 

70» I can't seem to make up my mind one way or another 

71 • I am confused 

72. I am satisfied with myself 

73* I am a failure 

74« I am likeable 

75* My personality is attractive ,o the opposite sex 

76. I am afraid of sex 

77. I have a horror of failing in anything I want to accomplith 

78. I feel relaxed and nothing really bothers me 
79* I am a hard worker 

80« I feel emotionally mature 

81 • I am naturally nervous 

82* I really am disturbed 

83» All you have to do is just insist with me and I give in 

84« I feel insecure %rithin myself 

85« I have to protect myself with excuses, with rationalizing 

86« I am a submissive person 

87« I am intelligent 

88« I feel superior 

89« I feel hopeless 

90. I am self-reliant 

91« I often feel aggressive 

92. I am inhibited 

93« I am different from others 

94« I am unreliable 

95« i understand myself 
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!• Have a Masters Degree in Speech Pathology 

2. Have at least five years professional experience 

3. Be able to relate well with others 

4. Habe a sincere regard for the handicapped 

5« Have a comprehensive background in learning theory 

6« Be mature 

7« Have a stable personality 

8. Have an extensive background in psychoanalytic theory 

9. Can train clients to become more sensitive to their own needs 

10. Has a comprehensive background in human anatomy and neurology 

11. Can work well with both organic and fu;)ctionally based problems 
12« Can relate structure to function 

13. Can understand the articles in JSHR 

14. Has a working knowledge in audiology 

15. Can work well with all age ranges 

16« Uses a multisensory approach to therapy 

17. Should be a specialist within hts field 

18. Promotes public awareness of the value and needs for speech therapy 
19« Knows the agencies available for aid in client job placement 

20* Understands human psychological reactions to illness 

21« Can converse intelligently with medical personnel 

22« Has a neat and clean personal appearance 

23. Establish realistic goals for the client 

24. Be able to plan effective rehabilitation procedures 

25. Have a good background in psychology 
26« Be a good diagnostician 

27. Be able to work well with others 

28« Readk professional journals 

29. Should have a high tolerance for ambiguity 

30« Should stick to speech therapy and not personal problems 

31* Should not be easily embarrassed 

32. Should make referrals 

33« Should consult with colleagues when uncertain 

34« Works independently without supervision 

35« Should not look upon himself as a psychotherapist 

36. Is a member of ASHA 

37« Is flexible and open minded 

38. Expresses himself well 

39. Is well adjusted 

40. Understands himself 

41. Uses a tape recorder as therapy 
42« Is task oriented 

43* Knows the value of negative reinforcement 

44. Rewards the clients for good speech production 

45. Is certified by the ASHA 

46. Enjoys doing therapy 

47. Shows empathy 

48. Is professional in his dealing wlch others 
49« Is sensitive to the needsof others 

50« Gets along well with others 
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51. Accepts objective criticism 

52* Leaves diagnosis to the physician 

53* Considers other things more important than personal appearance 

54* Considers ability more important than formal academic achievement 

55* Allows client to establish his own goals 

56, Collaborates with client in planning rehabilitation procedures 

57, Stresses therapy^ not diagnosis 

58, Maintains an appropriate professional relationship with his colleagues 

59, Avoids becoming too theoretical about his discipline 
60* Has a low tolerance for ambiguity 

61, Becomes involved with the personal problems of his clients 

62* Tries to hide his embarrassments 

63* Avoids making referrals 

64* Dislikes being supervised 

63* Feels little or no need to consult with colleagues 

66* Requires supervision 

67* Is qualified as a psychotherapist 

68« Leaves administration to the administrator 

69* Avoids involvement with professional organizations 

70« Does not feel obligated to have perfect speech himself 

71* Believes that actions are more important than verbal facility 

72* May have personal problems 

73* Is not too introspective 

74* Feels no need for special electronic equipment 

75* Is person oriented 

76* Uses negative as well as positive reinforcement 

77, Feels that ASHA certification is an irrelevant requirement 

78* Maintains social distance 

79* Enjoys seeing the results of therapy 

80* Avoids impulsive responses like laughing 

81« Is never overly professional 

82* Is not overly concerned with the needs of others 

83* I not too sociable 

84* Is youthful 

85* Has a volatile personality 

86 • Is more concerned with practicality than with theory 

87* Avoids sentimentality 

88. Tries to avoid being evaluated by others 

89. Believes that it is ability that counts, not professional experience 
90* Sees little relationship between amount of study and clinical skill 
91* Believes that a clinician does not need to know psychoanalytic theory 
92* Has no business doing anything about a client's sensitivity to his 

own needs 

93* Is not concerned with fees 

94* Does not dwell on ethical questions 

95* Does not use tokens or similar items to reward desirable speech 
behavior 

96* Feels a knowledge of anatomy and physiology is of little practical 
value 
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97* Prefers to work with organically based problems 

98. Is concerned less with structure than witl;^ function 

99. Is more interested in application than th(6ory 
100* Needs little background in audiology 

lOl. Works more effectively with children than with adults 

102* Uses a unis^nsory approach to therapy 

103* Is not concerned with educating the public about the value of speech 
therapy 

104* Works with all types of speech problems 

105* Need not be a good teacher 

106* Does not become emotionally involved with the welfare of his patients 

107* Leaves job placement to others 

108* Feels little need for a background in child psychology 

109* Is not concerned about the difference between apraxia, agnosia ans 
aphasia 

110« Feels little need to have a background in medical terminology 

111* Understands the significance of social reinforcement 

112* Understands the techniques and issues of verbal conditioning 

113* Understands the essentials of secondary reinforcement 

114* Is familiar with schedules of reinforcement 

115* Is familiar with behavior modification terminology 

116* Is familiar with behavior modification techniques 

117. Understands behavior modification theories and methods to self- 
confrontation 

118« Appreciates the significance of **base rates" 

119* Knows the significance of immediate reinforcement 

120* Understands the nature and the effects of punishment 



-55- 



SELF^PERCEPTION QUESTIONNAIRE 



Appendix C 



Think of how you appeared and sounded on the videotape 
you have seen* Then, rate yourself on the scales below* 
Try not to rate yourself on the basis of your impression 
of yourself from past experience, instead, try to base 
your rating of yourself on what you saw on the videotape* 
Please circle the number which you feel is closest to 
your Judgment or feeling* 



Pleasant 


8 


J 6 


5 


4 


3 


2 


1 Unpleasant 


Friend Iv 


8 


1 6 


5 


4 


3 


2 


1 Unfriendly 


Rei ec tlna 


8 


1 6 


5 


4 


3 


2 


1 Acc^ntlnc 

^ ••W W V L/ W A ■ *0 


Heloful 

A»C * ^ U * 


8 


J 6 


5 


4 


3 


2 


1 Frtifttf Atinff 


U n^nt hus i. aa t i. c 


8 


1 6 


5 


4 


3 


2 


1 EnthuaiAatlc 


Tense 


8 


J 6 


5 


4 


3 


2 


1 Relaxed 


Distant 


8 


1 6 


5 


4 


3 


2 


1 Close 


Cold 


8 


7 6 


5 


4 


3 


2 


1 Warm 


Cooperative 


8 


1 6 


5 


4 


3 


2 


1 Uncooperative 


Supportive 


8 


1 6 


5 


4 


3 


2 


1 Hostile 


Boring 


8 


1 6 


5 


4 


3 


2 


1 Interesting 


Quarrelsome 


8 


1 6 


5 


4 


3 


2 


1 Harmonious 


Self-Assured 


8 


1 6 


5 


4 


3 


2 


1 Hesitant 


Efficient 


8 


1 6 


5 


4 


3 


2 


1 Inafficient 


Gloomy 


8 


1 6 


5 


4 


3 


2 


1 Cheerful 


Open 


8 


7 6 


5 


4 


3 


2 


1 Guarded 
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SELF-CONFRONTATION QUESTIONNAIRE 



Appendix D 



Based on the tape of yourself you have just seen, please answer the 
questions below* Circle the number which you feel comes closest to your 
feelings, opinion, or eveluation* 

How do you feel about this experience? How valuable was this experience 
as an aid in learning the practical aspects of therapy? 

123456789 
Quite Fairly Neutral Fairly Quite 

Valuable Valuable Value- less Value-less 

To what extent did you look and sound like yourself on the videotape? 

123456789 
Exactly as Sorsewhat Neutral Not very Not at all 

I imagined like me much like me as I imagined 

I would I would 

How effective were you in getting the client to respond or do what you 
want? 

123456789 
Quite Fairly Neutral Fairly Quite 

Effective Effective Ineffective Ineffective 

How effective were you in describing, explaining, demonstrating, or model* 
ing behavior to the client? 

123456789 
Quite Fairly Neutral Fairly Quite 

Effective Effective Ineffective Ineffective 

How effective were you in rewarding the client for proper behavior? 

123456789 
Quite Fairly Neutral Fairly Quite 

Effective Effective Ineffective Ineffective 

How effective were you in negatively reinforcing the incorrect client 
behavior? 

123456789 
Quite Fairly Neutral Fairly Q^iite 

Effective Effective Ineffective Ineffective 

To what degree were you open, warm, and friendly as opposed to cold, 
distant and withdrawn with the client? 

123456789 
Quite warm Fairly war* Neutral Fairly cold Quite cold 

and friendly and friendly and distant and distant 
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SELF-CONFRONTATION QUESTIONNAIRE 
continued 



Appendix D 



To what degree were you directive and dominant as opposed to permissive 
and nondirective? 



1 

Quite 
Dominant 



3 

Fairly 
Dominant 



5 

Neutral 



7 

Fairly 
Permissive 



8 



9 

Quite 
Permissive 



Now rate the session from a clinical standpoint on the following items 
The materials used in therapy were: 

4 5 6 



1 2 
Highly useful 
and appropri- 
ate 



3 

Fairly 
Useful 



5 

Neutral 



7 8 9 

Fairly Quite useless 

Useless and inappropri- 
ate 



The room environment, including the table, blackboard, lighting, noise 
level, and so on, was: 



9 8 7 6 5 

Higlily Inadequate Neutral 

Inappropri- 
ate and 
distracting 



Adequate 



The techniques used in therapy were: 

2 3 4 



1 

Highly 
effective 
and useful 
to client 



3 

Fairly 
effective 



5 

Neutral 



7 

Fairly 
ineffective 



The client's overall performance and progress showed: 

1 2 3 4 5 6 



5 

Neutral 



3 

Great im- some 
provement improvement 
over previous 
sessions 



The level of fulfillment of therapy goals was 



7 

Slight 
Regression 



1 

Highly 
appropriate 
and Inviting 



8 9 
Highly Ineffec- 
tive and con- 
fusing to client 



8 9 
Regression 
to previous 
levels 



9 8 
None, no 
goals ful- 
filled 



Minimal 



5 

Partial 
fulfillment 



Fairly good, 
most goals 
achieved 



2 1 
Complete, 
all goals 
fulfilled 
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SELF-CONFRONTATION QUESTIONNAIRE 
continued 



Appendix D 



My performance, overall, as a clinician waa: 



9 8 
Highly in- 
effective, 
possibly neg- 
ative benefit 
to client 



Scmevhat 
ineffective 



5 

Neutral 



Somewhat 
effective 



1 

Highly 
effective 
and of great 
benefit to 
client 
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DOUBLE SELF-CONFRONTATION QUESTIONNAIRE 



Appendix E 



You have Just watched a tape of yourself as you viewed a therapy session. 
Please answer the questions below based on this viewing: 

How do you feel about this experience? How valuable was this experience 
as an aid to learning about yourself as a therapist? 

123456789 
Quite Fairly Neutral Fairly Quite 

Valuable Valuable Value-less Value-less 

To what extent were you open, flexible, and honest as opposed to defensive, 
closed, and anxious during the self-confrontation? 

123456789 
Quite Fairly Neutral Fairly Quite 

open open defensive defensive 

To what extent were you involved in the self-confrontation as opposed to 
uninvolved or withdrawn? 

123456789 
Quite Fairly Neutral Fairly Quite 

involved involved withdrawn withdrawn 

To what extent did you look like and sound like yourself on the tape? 

123456789 
Extremely Somewhat Neutral Pretty much Exactly as 

different different as I expected I expected 

from what from what 

I expected I expected 
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SPEECH AND HEARING THERAPY SCORING MANUAL 

The purpose of this manual is to help the clinician 
find out what is happening in speech and hearing therapy, 
his own or someone else's. By learning the several scoring 
systems included in the manual, it is possible to listen to 
an audiotape replay or to listen-to-watch a videotape re- 
play of therapy and score sequentially the therapy events 
as they occur. Or one could study a "live" session. By 
employing scoring matrices with the playback, it is possible 
to quantify the events of therapy in such a way that one 
could determine for example, how much the client talks, how 
much the clinician talks, the percentage of client correct 
and incorrect responses, clinician levels of response to 
client behaviors, etc. 

The scoring systems presented here can quantify the 
interaction between two people or between a clinician and 
a small group e Each thing that happens in therapy may be 
categorized. it is possible to categorize the behavior of 
the clinician and categorize the behavior of the client. 
Perhaps of even more importance, the events of therapy may 
be placed in the sequential order in which they occurred. 
The scoring system will also isolate the specific behavior 
of the clinician when the client makes a correct response 



and what the clinician does when the client makes an incor- 
rect response. For example, if the child makes an /r/ 
phoneme correctly in therapy and the clinician follows this 
correct production with a "that's good/' the child has re- 
ceived a "good evaluative" (a positive reinforcement) . Such 
positive reactions have the effect of increasing the child's 
correct /r/ production. If on the other hand, the child had 
said "wabbit" in response to the stimulus "rabbit" and the 
clinician responded, "that's not right", the child would 
have received a "bad evaluative" (punishment) . Such a dis- 
approving response from a clinician will often have inhibit- 
ing effects on the child's future incorrect response; if it i 
truly punishing to the child, he will attempt to make future 
/r/ words correctly. 

This content and sequence analysis of the events of 
therapy enables the speech and hearing clinician to analyze 
his own therapy. Through such taped playback, also, it is 
possible to study the therapy of anyone, such as the master 
clinician. Or the clinical supervisor can study the speech 
and hearing therapy of the clinicians he supervises; the 
supervisor can add quantification to his judgments of what 
is a "good" and what is a "bad" session. Such quantifica- 
tion of therapy may enable us to look at therapy effective- 
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ness. Historically, the field of speech pathology and audi- 
ology has placed its clinical focus on client pre- and post- 
evaluation with little emphasis given to evaluating the 
extensive therapy process which lies between our pre- and 
post-testing. 

Speech and hearing clinicians in any setting may be 
asked the question, "How do we know speech therapy does 
any good?" Such an accountability question is usually 
answered by our making pre- and post-test comparisons • 
While we are often convinced that our therapy has done some 
good, we never know for sure just what we did or did not do 
in therapy which helped produce the desired change. Using 
a category system to score our own therapy will tell us when 
the thing we did (and the kind of thing we did) produced 
change. Or if our therapy is ineffective, we can see the 
lack of change in what we are doing. 

The category systems presented in this manual may be 
applied to either audiotape or videotape playback. Four 
years of development* hi/e gone into these matrices with 
application of the systems used in various university train- 
ing programs and in public school-hospital settings. Our 
experience has found that in the typical 30-minute therapy 

* See references in bibliography at end of manual 



period, only a five minute segment need be analyzed for a 
representative sample of therapy* Early in our research 
efforts or confrontation we selected randomly this five 
minute sample; later, we found it to be more meaningful to 
select that section of therapy for analysis which the 
clinician himself felt to be most representative of his 
therapy » 

These therapy scoring systems have demonstrated their 
utilization with any kind of therapy problem — articulation, 
hearing, language, stuttering, and voice* While the ori- 
ginal model for the categoxy systems was an operant stimu- 
lus-response paradigm, system application has found the 
model adaptable to any kind of therapy approach, be it motor 
shaping, operant, traditional, non-directive — to name but a 
few of the more frequently used therapy approaches* Much of 
our early investigation utilized only two person interaction 
analyses, and only more recent group adaptation of the ten 
category system is included in this manual* 

For reader convenience and for ease in learning how to 
score therapy, each of the therapy analyses systems will be 
presented in this manual following this same format: 

Purpose of Category System 

Procedures for Using System 



Category Descriptions 
Sample Transcript 
Scoring Practice 
Data Analysis 

Utilization and Implications 
Scoring Forms 
Svuranary Data Forms 



TEN CATEGORY SCORING SYSTEM 
Individual Therapy 

Purpose of Category System 

The ten category system is ideal for scoring oneself. 
Although this system is highly useful for the external 
supervisor to use with or without the clinician joining 
him, the ten category system lends itself well as a tool for 
use in self -supervision. The ten category system can readily 
be learned by anyone interested in scoring the events of 
therapy. By using this system, the clinician who is employed 
in a setting without any direct supervision or consultation 
can determine "what is going on in his therapy". With some 
practice, it is possible to place each of the events into 
any one of the ten categories. 

Procedures for Using Ten Category System 

Individual therapy may be studied using the ten cate- 
gory system in one of two ways: single confrontation or 
double confrontation. In single confrontation, the clini- 
cian records himself using either audiotape or videotape 
in therapy. He then selects a five minute segment of the 
playback and scores this. In double confrontation, one 
records himself in therapy, watches the five minute play- 
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back with his supervisor^ and records himself watching him- 
self. He then watches himself watching himself. This 
double procedure may sound rather complex and unnecessary^ 
but we do have research data which confirms that double 
confrontation is most valuable for people who tend to rate 
themselves too low (see Boone and Goldberg^ 1969) . The 
double confrontation seems to have the effect of forcing 
people to raise their self-images to more realistic levels 
(those levels that the professional peer world seems to 
view them). Single confrontation requires only one recorder^ 
audio or video. Double confrontation requires two video- 
tape recorders as you must record on one instrument what 
is being played back on the second. We will develop the 
confrontation procedures separately for single and double 
confrontation using the ten category system. We might add 
that double confrontation has only been tried with studying 
individual therapy sessions using the ten category system. 
Listed below are the separate steps required for using the 
system in single confrontation: 

1. The clinician records^ using either audiotape or 
videotape^ most of the therapy session. 

2. The clinician (and/or the supervisor) selects five 
minutes from the total session. Perhaps any five 



minute segment is appropriate that the clinician 
would like to see again or feels is representative 
of the session. 

3, The five minute segment is played back without 
stopping. It is then rewound and played back 
again. This time it is scored. 

4. The clinician scores the playback using the ten 
category system, stopping the playback whenever 
necessary. Scoring of a typical five minute seg- 
ment takes the scorer a total of about seven to 
eight minutes. 

5» Segment scores are then totaled and summarized on 
t-he session scoring form. The scorer computes the 
various ratios on the Session Scoring Form. The 
average length of time for determining and re- 
cording the data on the session scoring form is 
about seven or eight minutes. 
6. Total self-scoring time using the ten category 
system is approximately 20 minutes (five minute 
playback, seven or eight minutes scoring on second 
playback, seven or eight minutes of summary scoring) . 

Listed below are the separate steps to be used in double 

confrontation using the ten category system: 



1. The clinician records, using either audiotape or 
videotape, most of the therapy session. 

2. The clinician (and/or the supervisor) selects five 
minutes from the total session. 

3. The five minute segment is played back without 
stopping. It is then rewound and played back 
again. This time it is scored. 

4. The clinician and his supervisor are videotaped 
while they are watching the therapy playback and 
scoring of the tape. This new taping of the play- 
back requires, obviously, a second videorecorder. 
The scoring of a typical five minute segment will 
require about seven to eight minutes. The second 
taping is done while the seven to eight minute 
scoring session is going on; therefore, no addi- 
tional time is required for the second t ping. 

5. The segment scores are totaled and summarized on 
the session scoring form, which will require ap- 
proximately another seven or eight minutes. 

6. The clinician (and perhaps the supervisor) watch 
the second replay which requires seven or eight 
minutes. The clinician literally watches himself 
watching himself. This second playback is not 



10 



scored and allowed to run without stop/start. 
The value of this double confrontation appears to 
be in improving self-image, as described by Boone 
and Goldberg, 1969 (see Bibliography) . 



Ten Category Descriptions 

Category 1 Explain, Describe 



Category 2 Model, Instruction 



Category 3 



Good Evaluative 



Category 4 Bad Evaluative 



Clinician describes 
and explains the 
specific goals or 
procedures of the 
session. 

Clinician specifies 
client behavior by 
direct modeling or 
by specific request. 
Clinician evaluates 
client response and 
indicates a verbal 
or non-verbal approval. 
Clinician evaluates 
client response as 
incorrect and gives 
a verbal or non-verbal 
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disapproval* 

Category 5 Neutral- Social Clinician engages in 

behavior which is not 
therapy goal oriented* 

Category 6 Correct Response Client makes a response 

which is correct for 
clinician instruction 
or model* 

Category 7 Incorrect Response Client makes incorrect 

response to clinician 
instruction or model. 

Category 8 Inappropriate- Social Client makes response 

which is not appropri- 
ate for session goals. 

Category 9 Good Self-Evaluative Client indicates aware- 
ness of his own correct 
response. 

Category 10 Bad Self -Evaluative Client indicates aware- 
ness of his own incor- 
rect response. 

Sample Transcript Using the Ten Categories 

The following transcript of a brief section of a therapy 
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session illustrates the application of the ten category sys- 
tem to actual therapy events: 



Cateqoirv # 
1 

8 



8 



5.1 



_8_ 
5^ 

8 



Speaker Dialogue 

Clinician: Well, today. Topper, we're 

going to go over our /r/ words. 
Client: We're going to go hiking over 

the weekend. 
Clinician: You'll have a lot of time to 

practice your new /r/ sound 

up there. 

Client: We get to stay up until Monday 

morning e So I won't be here 
next week. 

Clinician: Let's talk about the camping 
trip when you get back. To- 
day I want us to get some work 
in. 



Client: 
Clinician: 



Client: 



You never want to talk anymore. 

We just don't have the time to 

talk so much. Topper. 

You want to go with us, don't 

you? 
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1 Clinician: We'll start saying our /r/ 

words now, I'll turn on the 
recorder and if we get a good 
one, we'll play it back and 
let you hear it. 



2 Rah , rah , rah . 

1 Say the words after me now. 

Topper, I want to hear those 
/r/s coming through, 

2 Rah, rah, rah. 
/ Client: Wan, wah, wah. 

4 Clinician: I don't want "wahs". 

2 Client: Wah, wah, wah, wah. 

4 Clinician: Nope. 

1 You're rounding your lips 

too much. 

10 Client: I never could say it right. 

1,3 Clinician: Did I h^ar you say "right"? 

That was a perfect /r/. 

Topper. 

2 Say, "right, right, right" . 
6 Client: Right, right, right. 
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Client: 



Client : 
Clinician: 
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Hey^ how come that /r/ is 
so good? 



Clinician: Let's hear that good /r/ 
again* 

Tape Recorder: rights rights 
right » 

Rights rights right* 
Now you've got it just the 
way we want it. 



15 



Scoring Practice 

The therapy dialogue above has been scored using the 
ten category scoring form below: 

TEN CATEGORY SCORING FORM 

Categories 



Total 




You will note that we use a continuous line from one 
categor;^' to another. This continuous line allows the scorer 
to "know" where he is on the scoring form without requiring 
close visual attention. We have found it to be a quicker 
and more accurate way of scoring, rather than just putting 
a dot or an X in each category row. 

Count the frequency of each category event by counting 
the number of times a category occurred during the scored 
therapy segment. These summarized counts are then written 
on the right margin of each scoring sheet. Eventually the 
total numbers and identified sequences are transferred to 
the Session Scoring Form (page 16). Read the transcript 
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again and see if you can mark the scoring form below to 
match the one already scored on that session which is shown 
above. Cover the scoring model above while you do this. 
When you finish scoring, see if the model matches what you 
have done. 

Categories Total 

1. Explain 

2. Model 

3 . Good 

4> Bad 

5. Social 

XXXXX^aOQPOQOCXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX}^^ 
6> Correct 

?♦ Jincorrect 

8. Social 

9. Good Self 

10 > Bad Self 



If you scored the practice scoring form correctly, you 
may already know the ten category system and be ready to do 
some practice scoring. If you didn't agree with the scoring 
model of the transcript, go over the category descriptions 
once again on pp. 12-14. Try the scoring again, if you 
feel this would help you, by going back to the transcript, 
masking out the category designations and score the practice 
form below: 
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Categories Total 

1> Explain 

2. Model 

3 , Good 

4o Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx^^ 

6, Correct 

7c Incorrect 

8> Social 

9, Good Self 

10 > Bad Self 



Before practicing some more transcript scoring on prac- 
tice forms, let us briefly review the process. Each event 
of therapy is categorized into one of the ten categories 
described. When it is difficult to make a decision as to 
precisely what category should be assigned the event, make 
the arbitrary decision to place the behavior where you think 
it most belongs. Since the categorization is generally of 
one's own therapy, there is no absolute in categorization. 
If you're wrong about occasional categorization, it wi]l not 
seriously impair youi overall categorization effectiveness. 
Learn to make your category decision quickly on the typed 
transcripts so you can then practice scoring the fast move- 
ment of an actual session, as heard or viewed on taped play- 
back. You will fine? that the continuous line on the scoring 
form, leading from category to category, makes the task 
easier and quicker. 
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We will now include two brief transcripts. Score each 
one separately on the sample scoring form below the trans- 
cript. The first transcript includes our category scoring; 
mask our category numbers and see if you agree with our 
scoring. The second transcript has not been scored by the 
authors. 

Sample Scoring Transcript frl 

Category Speaker Dialogue 



1 Clinician: O.K. First, we will work on the 

sounds a little bit. What is 
your sound? Let's turn on the 
tape recorder. What is your 
sound, Richard? 
8 Richard: Huh? 

2 Clinician: Wha- is your sound? 

7 Richard: Oh yeah... I am Wichard. . .wwwww 
6 rrrrrrr rr 

3 Clinician: Very good. You changed it. We 

won't go back and listen to it 
right away. But I want you to 
If 2 hear that rrrrrrr. 

6 Richards rrrrrrr. 



3 Clinicians 
1 

2_ 

6 Richard : 

3 Clinicians 
1 



8 Richard : 

1 Clinician; 

8 Richard ; 

1 Clinicians 



2 (On tape) 

2 Clinician: 
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You're keeping your tongue up 
there, Richard. Did you hear 
that? You flipped it right up. 
rrrrrrrr. 
rrrrrrr . 

Good. Let's listen to that. 
Let's go back and listen to that. 
You can even make counts of that. 
You write down the ones you think 
are good as you listen to it. 
Make it up to five. 
Fxve is the best. Five is Mrs. 
Streit' s. 

No. Mrs. Streit is down here 
and five is the best. 
Five is the best. Is Mrs. Streit 's 
U.K.? Is mine O.K. too? Shall I 
write upside down? Let's listen 
and you mark down every time you 
hear one. 

Oh yeah. . . .Wichard 

What did you think of Wichard? 
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6^ 
1^ 

1 



3^1 

6 



Richard: 
Clinician: 

Richard: 
(On tape) 
Clinician: 



Richard: 

Clinician: 

Richard: 



Categories 



1> Explain 



I mean Richard? Did you like it? 
Nods yes 

Should we go back and listen to 

it? 

Yeah. 

Oh yeah, • • .Wichard 

I want you to listen to that 
and see if you really like it. 
Maybe you'll hear some better 
ones later. Was that Wichard or 
Richard? 
Wichard. 

Yeah. Is that a 1, 2, or 3? 
It is about a 1. 



Clinician: You didr't like it. I think you 



are right. 



Total 



2 . Model 



3 . Good 

4. Bad 



5. Social 



xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6. Correct 

7. Incorrect 



8. Social 



9^ Good Self 



10. 



Bad Self 
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Sample Scoring Transcript #2 

Category Speaker 

(On tape) 

Clinician: 



Dialogue 

rrrrrrrr very good. . . . 

There were two there. What was 



the first one like? 
Richard: rrrrrrr. . . they were kind of like 

the same. 

Clinician: Now listen I don't think they 

are... quick now... 
(On tape) rrrrrrr 
Clinician: Did they change? 
Richard: Yeah... the first one was kinda 

like a 2. 

Clinician: Right. Very good listening. 
(On tape) Right... you flipped it up...rrrrrr 

R-i Aard: That one is a (writes a 3 on the 

paper) 

Clinician: A 3 huh? Kind of inA>etween. 
(On tape) rrrrrrrr 

Clinician: Vlhat did you think of that? 
Richard: That was about a one or maybe 

a three. 
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Clinician: I think it was about a three. 

A pretty good try. 
(On tape) rrrrrrrrr 

Clinician: Oh boy I What was that one? 

Richard : rrrrrrr 

Clinician: Which one? 

Richard: (Marks a two on the paper) 

Clinician: Oh, you have to be careful. 

That was a good one. You got 
a good "r" sound. I*d even put 
it under 5. I really think it 
was an excellent one. Want to 
listen to it again? That was 
so good I want you to hear it 
again because you really got 
that sound. 

(On tape) rrrrrrr 

Clinician: Good. You kinda went off and 
then you went back on again. 
I'd count that as a pretty good 
one. Are there any more? 
Nope. That is all. We will 
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Richard: 
Clinician; 

Richard: 
Clinician; 



Ri chard: 

Clinician; 

Richard : 

Clinician; 

Richard : 

Clinician; 

Richard: 

Clinician; 

Richard: 

Clinician; 

Richard: 
Clinician; 
Richard : 



start from here. O.K.? And we'll 
record some more, 
(nods) * 

Let's work a little bit on 

row - row - row 

Wow - wow - wow - wow 

Uh... let's try that again... 

it wasn't too bad... 

row - row - row 

wow - wow - wow 

row 

wow 

ready 

weady 

ride 

wide 

run 

wun 

O.K,*..how about this word... 
car sun 
cah sun 
car sun 
car sun 
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Clinician: 

Richard : 

Clinician: 

Richard; 

Clinician: 

Richard: 

Clinician; 

Richard : 
Clinician: 
Richard : 
Clinician: 



How about car moon? 



cah moon 



car 



cah 



Almost. . .car 



car 



Almost got there, Richard... 
can you do it again? 



car 



car. •.oh, almost there, isn't it? 



car 



Right. Car. 



Categories ^ Total 

1. Explain 

2. Model - 

3 . Good 

4 Ead 

5. Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXSQOQOCXXXXXXXXXXXXXXXXXXX^ 

6> Correct 

7o Incorrect 

8. Social 

9. Good Self 



10. Bad Self 
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Categories ^ Total 

1, Explain 

2, Model ; 

3 , Gcod 

4, Bad 

5> Social 

XXXXXXXXXXXXXXXXX300CXXXXXXXXXXXXXXXXXXXX)QOCX3QOOQC^^ 
6> Correct 

7, Incorrect 

8, Social 

9, Good Se lf 

10, Bad Self 



Accuracy and quickness in scoring of therapy improves 
with practice. You will find included in the section. 
Scoring torms on page 36 , ample practice forms for use in 
further scoring practice. 



Data Analysis 

The reason v/e score therapy tapes, either audio or 
video, is to find out what happens in therapy. We may use 
the same scoring system "live" if we wish, observing and 
scoring therapy that is in process. The obvious advantage 
of scoring a taped segment is that the tape can be stopped 
and/or restarted for the scorer's convenience. "Live" 
scoring requires tliat the scorer have considerable scoring 
experience. Regardless of the method of the scoring, how- 
ever, the individual scores and score sequences should have 
meaning to the clinician or his supervisor. The data which 
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we r^btain is transferred to the Speech and Hearing Therapy 
Session Scoring Form. 

The Session Scoring Form on the following page repre- 
sents the suniniary data obtained from the sample transcript 
describing the boy. Topper, as seen on page 12 . The Ten 
Category Scoring Form for that transcript is on page 15 . 
The summary data (the frequency of occurrence for each of 
the ten categories) is summarized in the right hand margin 
of the- form. These summary data are then totaled under the 
Category Counts coltimn. For example, category 1, Explain, 
occurred eight times in the total segment; category 2, Model, 
occurred 5 times; category 3, Good, two times; etc. A total 
of 29 categories occurred, 19 by the clinician and 10 by the 
client. TOiese raw counts are then further used. The Se- 
quence Counts coltimn is where particular category sequences 
are recorded. For example, category 6 is followed by a 3 
only one time; category 7 is followed by category 4 two 
times; category 8 is followed twice by either a category 1 
or 2. These sequences will be utilized, along with indi- 
vidual category counts for computing the various ratios 
listed under Ratio Scoring. 

The ratios under the Ratio Scoring column are generally 
computed by counting one kind of beha'-ior and dividing that 



TEN CATEGORY 

SPEECH AMD HEARING THERAPY 
SESSION SCORING FORM 



Clinician: JariC 
Client: Tc>pp<'-'~ 
Date: z - X- II 



Category 


Cateqor\- Counts 
# of Events °/ 


i of Total 


Category 


Category Counts 
# of Events „ " 


Vo of Total 


i 






6 






2 


s" 


i 7.- 


7 






3 




0 7 


8 




. 


4 


1 


07 




/ 




5 




01 


10 


/ 


03 


C linician 
Total 


(f 




Client 
Total 



















Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



0 



Ratio Scoring 



Correct Response 6,7 = - "SO 

7 

Incorrect Response 6,7 = -50 

6/3 

Good Eval Ratio 6 = 

7/4 

Bad Eval Ratio 7 = 

8 

Inappro. Response 6,7,8 = 

8/1 > 2 

Direct Control 8 = oO 

5+8 

Socialization Total = Zl 



/ 00 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1—2— @— 4— 5—6—7—8—9 
1 — 2— <3)— 4— 5— 6— 7— 8— 9 
1—2—3—^-5—6—7—8—9 



Comr.ents: foppvr v>oa6 rCiy/^-S. dif:PiL.oif to Co?ntro/ -^odjXy 



28 

behavior by a summary of several behaviors. For example, 
the first ratio shown. Correct Response, is computed by 
adding the total number of correct responses (category 6) 
and dividing this by the total number of correct (category 
6) and incorrect (category 7) responses, which in effect, 
yields the percentage of correct responses. We are able 
to compute the percentage of incorrect responses, good 
evaluatives, bad evaluatives, inappropriate responses, 
direct control of child after an inappropriate response, 
and socialization between client and clinician. 

Each therapy session is also rated by the clinician 
relative to session effectiveness, therapist effectiveness, 
and client effectiveness; some objective measure (such as 
counting number of correct responses in a set, pre-determined 
task) is also added as quantitative data characterizing the 
particular session. When the Session Scoring Form is com- 
pleted, the events of therapy have been categorized and the 
clinician's impressions and effectiveness measures have 
been recorded. If the clinician and/or his supervisor are 
interested in studying only one particular therapy session, 
no further recording of data is necessary. The Session 
Scoring Form may be analyzed in several different ways, 
as we will discuss in the next section, Utilizr.tion and 
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Implications. However, if either the clinician or the 
supervisor is desirous of keeping over time the clinical 
data, either on a single client or on the overall clinician 
caseload, the data is summarized on the Clinician Tabula- 
tion Sheet. The data from each individual therapy segment 
that hau been scored is recorded on this summary sheet, 
which provides spaces for recording 16 successive session 
siimmaries. An example of use of the Clinician Tabulation 
Sheet would be for the clinician to use such a summarization 
for one of his clients; that is, once weekly he would score 
a recorded segment of his therapy; he would then place his 
summary scores on the Tabulation Sheet; he would then have 
recorded data for 16 continuous and successive therapy 
sessions. A Clinician Tabulation Sheet has been completed 
for the therapy segment scored for the sample Session 
Scoring Form on page 27 . 
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Percentage 
of 

Categories 


% Of Total Accounted for by 
Clinician Events 


% Of Total Accounted for by 
Client Events 


Correct Response Ratio 


Incorrect Response Ratio 


Good Evaluative Ratio 


Bad Evaluative Ratio 


Inappropriate Response Ratio 


Direct Control Ratio 


Socialization Ratio 


Therapy Evaluation Over Time 


Session Qucility Rating 


Therapist Effectiveness Rating 


[client Progress Rating 
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Utilization and Implications 

This kind of content and sequence a lalysis revealed 
by the scoring of therapy permits us to become aware of what 
is going on in therapy. F/ scoring what happens, we will 
be able to see what we are doing and what our clients are 
doing. If we thiiik we have a good session, or a bad one 
for that matter, we should be able to quantify the "good- 
ness" or "badness" of that session. Since this is only a 
method of quantifying what happens in therapy, the quanti- 
fication itself has no meaning. We must relate the values 
obtained to the type of client problem and to the particular 
session goals we might have for the client. In effect, we 
may use the data any way we wish. 

For example, the sample session of Topper, which we 
have used as an example scoring session, has yielded a 
number of values. We found that 66% of the session acti- 
vity is dominated by the clinician with the boy performing 
only 34% of the time. In the investigations reported in 
the Bibliography, it was found that in the typical therapy 
session that clinician activities usually do not exceed 60% 
of the total session activities. In this case, control of 
the boy might have required more than average clinician 
participation. The boy was only successful 50% of the time 
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stimuli were presented to him. Generally, our finding is 
that successful therapy is characterized by the client 
making 60 to 80% correct responses. Perhaps the activity 
was too difficult for the boy or perhaps the overall 
session was too uninteresting. His correct responses were 
followed by good evaluations 50% of the time; his errors 
were always followed by a negative evaluation by tha 
clinician. Perhaps his relatively high rate of incorrect 
responses contributed to his somewhat random, conversational 
behavior, which accounted for 50% of all of his responses 
in the therapy session. Half of the time the clinician 
ignored his inappropriate responses, following them with 
either a new explanation or a new model. Both the client 
and the clinician engaged in socialization 21% of the time. 
On a nine point rating scale the clinician rated her session 
a 3 for overall session quality, a 3 for personal therapy 
effectiveness, and a 4 rating for client progress. 

All of the above quantification was extracted from a 
sample therapy segment which lasted approximately only one 
minute. In the typical five minute therapy sample, we 
would have about five times more data to report. Our 
scoring and summary procedures would be the same. Obviously, 
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the scores by themselves would have little meaning. There- 
fore^ the clinician and/or his supervisor must place value 
judgments relative to what the various category counts and 
sequences m^an. 

The scoring system is only a measurement tool which 
encibles us to study more precisely speech and hearing 
therapy. It can make us aware of the clinical behaviors 
of both clinician and client. How much of any one event 
or sequence of events we want to do in any one session must 
be determined by the clinician or the supervisor. What the 
measurements mean requires clinical judgment. For example, 
as noted in the above example, the clinician performed 66% 
of the therapy events; whether this percentage of clinician 
activity is "good or bad" is wholly dependent on the situ- 
ation surrounding the therapy. All the category system can 
do for us is identify the various percentages and ratios 
of events to which we must apply our relative therapy 
values. 

The ten category system is basically designed for 
studying oneself in therapy. This system does not identify 
the type of modality (auditory, visual, or kinesthetic 
modeling) we might provide the client nor does it specify 
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if his responses were nonverbal or verbal (auditory or 
visual) . We might point out: that the nineteen category 
system presented on pp. 104 to 109 includes modality speci- 
ficiation. Identifying what the instruction or response 
is does not appear necessary, however, in self -scoring. 
We already know what the stimuli and responses were. The 
category system only summarizes the events and the sequence 
of events. Specification of modality is usually not neces- 
sary when scoring yourself. Supervisors have also found 
that the ten category system lends itself well for sequenc- 
ing the therapy session of someone else. If it becomes de- 
sirable to note specifics of stimuli or response, we have 
found just writing the notation on the scoring sheet at 
the place the behavior occurred serves as a handy way of 
remembering what happened. Many times a supervisor may 
score a session using the ten category system without the 
clinician being present; later, they can "relive" the ses- 
sion by following the sequence of events on the Ten Cate- 
gory Scoring Form. Once, again, noting on the form speci- 
fic words representing a topic to be remembered, or a stimu- 
lus, or a response pattern to be recalled, will serve the 
supervisor and clinician very well in their reconstruction 
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of the therapy session. If the session has been either 
audio or videotaped, there is little need to add these 
key words to the scoring form as direct observation of 
the event will facilitate rather complete recall. 

Finally, let us say once again, use the ten category 
system and its scoring forms as you wish. It is designed 
to help you study the content and sequence of events of 
your therapy. Do not become so bewildered by its mech- 
anics that you find yourself unable to use it. Practice 
scoring some of your own tapes. Use the practice forms and 
summary forms as you wish. Our average student was able 
to learn the ten category system validly and reliably 
after =>''.out one hour of. practice. Additional practice, 
however, will make the ten category system quickly functional, 
enabling you to use the system with only minimal stop- 
starting of the tape recorder. Obviously, live scoring 
requires continuous practice because the typical events 
of therapy move surprisingly fast. 
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Categories Total 

1. Explain 

2. Model 

3 . Good ^ 

4> Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6> Correct 

?♦ Incorrect 

8> Social 

S> Good Self 

10> Bad Self 



Categories Total 

1> Explain 

2. Model 

3> Good 

4> Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxy^ 

6. Correct 

7 , Incorrect 

8> Social 

9. Good Self 

10> Bad Self 



Categories Total 

1. Explain 

2. Model 

3 . Good 

4o Bad 

5, Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX?^^ 

6, Correct 

7o Incorrect 

8, Social 

9. Good Self 



10, Bad Self 
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Categories Total 

1, Explain 

2. Model 

3 > Good 

4, Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6. Correct 

7 > Incorrect 

8, Social 

9. Good Self 

10. Bad Self 



Categorie s Total 

1> Explain 

2. Model 

3 . Good 

A. Bad 

5. Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX^ 

6. Correct 

1. Incorrect 

8, Social 

9, Good Self 

10. Bad Self 



Categories Total 

1* Explain 

2. Model 

3 . Good 

4. Bad 

5. Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX^ 

6. Correct 

7c Incorrect 

8, Social 

9> Good Self 

10. Bad Self 



1 , Explain 

2, Model 

3 , Good 

4> Bad 

5, Social 

XXXXXXXXXXXXXX300OOQDO0QQQO0OQDOCXXXXXXX)0QQOQOO0CXX3^^ 

6, Correct 

1 . Incorrect 

8, Social 

9. Good Self 

10, Bad Self 



Categories Total 

1« Explain 

2. Model 

3 > Good 

4, Bad 

5> Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX?OQDQOOOQQ^^ 

6, Correct 

7> Incorrect 

8> social 

9> Good Self 

10> Bad Self 



Categories Total 

1> Explain 

2, Model 

3, Good 

4, Bad 

5, Social 

XXXXXXXXXXXXXXXX?OCXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX3^^ 

6, Correct 

7o Incorrect 

8> Social 

9> Good Self 



10> Bad Self 



ERiC 
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Categories Total 

1. Explain 

2. Model 

3 > Good 



4> Bad 



5> Social 



XXXXXXXXXXXXXXXXXXXXX> A, xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 
6> Correct 

7 , Incorrect 

8, Social 

9, Good Self 



10. Bad Self 



Categories Total 

1> Explain 

2. Model 

3 > Good 



4. Bad 



5. Social 



XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX3DQQQOQOC^^ 
6. Correct 



7 . Incorrect 



8» Social 



9. Good Self 



10> Bad Self 



Categories Total 

1. Explain . 



2. Model 



3 . Good 



Bad 



Social 



XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXffiQOQQOCXXXXX3^^ 

6> Correct 

7c Incorrect 

8, Social 

9. Good Self . 



10, Bad Self 



ko 



Categories 



Total 



1* Explain 



2. Model 



3 , Good 



4, Bad 



Social 



xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6> Correct 

7, Incorrect 

8> Social 

9. Good Self 



10 > Bad Self 



Categories 



Total 



1> Explain 



2. Model 



3 . Good 



4. Bad 



5, Social 



6. Correct 



Incorrect 



8, Social 



9^^ Good Self 



10 > Bad Self 



Categories 



Total 



1* Explain 
2, Model 



3 . Good 



4o Bad 



Social 



»QQQQQQ0QQQQQQOQO0CXXXXXXXXXXXXXX}0Q0O^^ 
6, Correct 



Incorrect 



8. Social 



9. Good Self 



10, Bad Self 
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Categories Total 

1, Explain 

2, Model 

3 , Good 

4, Bad 

5, Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6, Correct 

7, Incorrect 

8, Social 

9, Good Self 

10, Bad Self 



Categories Total 

1, Explain 

2, Model 

3 , Good 

4, Bad 

5, Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX?OC^^ 

6, Correct 

7 « Incorrect 

8, Social 

9. Good Self 

10, Bad Self 



Categories Total 

1. ExplP > in 

2. Model 

3 . Good 

4c Bad 

5, Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXl^^ 

6, Correct 

7c Incorrect 

8, Social 

9, Good Self 



10, Bad Self 
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Categories Total 

1* Explain 

2. Model 

3 ♦ Good 

4 > Ba d ^ 

5> F.rcial ^ 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6> Correct , 

7> Incorrect 

8, Social 

9. Good Self 

10> Bad Self 



Categories Total 

1« Explain 

2> Model 

3 > Good 

4> Bad 

5> Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXfflQQOQOCXXXXXX^ 

6, Correct 

7> Incorrect 

8> Social 

9, Good Self 

10 > Bad Self 



Categories Total 

1> Explain 

2> Model 

3 > Good ^ 

4o Bad 

5, Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6> Correct 

7o Incorrect 

8> Social 

9> Good Self 



10> Bad Self 
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Categories Total 

1> Explain 

2. Model 

3 . Good 

4. Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx3nc^^ 

6> Correct 

7 , Incorrect 

8. Social 

9. Good Self 

10, Bad Self ~~ 



Categories Total 

1, Explain 

2, Model 

3 • Good 

4, Bad 

5. Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX)Q0QQQQ0QP0CXXXXXXXXXXXXXX3^^ 

6. Correct 

7 , Incorrect 

8, Social 

9. Good Self 

10, Bad Self 



Categories Total 

1. Explain 

2, Model 

3 , Good 

4. Bad 

5. Social 

xxxxxxxxxxxxxxxxxxx?cxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx^^ 

6, Correct 

7 c Incorrect 

8, Social 

9, Good Self 



10, Bad Self 



Categories Total 

1, Explain 

2. Model 

3 > Good 

4, Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6> Correct 

7 > Incorrect 

8, Social 

9. Good Self 

10> Bad Self 



Categories Total 

1> Explain 

2. Model 

3 > Good 

4, Bad 

5> Social 

XXXXXXXXXXXXXXXXXXiOQCXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX^ 

6 , Correct 

7> Incorrect 

8> Social 

9, Good Self 

10> Bad Self 



Categories Total 

1> Explain 

2> Model 

3 , Good 

4o Bad 

5, Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXyiDQQQCKXXXXXXXXXXXXXXXXX^^ 

6, Correct 

7c Incorrect 

8> Social 

9, Good Self 



10 > Bad Self 
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Categories Total 

1> Explain 

2, Model 

3 , Good 

4, Bad 

5, Social 

XX?OOOQOQCXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

6> Correct 

7 . Incorrect 

8, Social 

9- Good Self 

10, Bad Self 



Categories Total 

1> Explain 

2, Model 

3 , Good 

4, Bad 

5> Social 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

6, Correct 

7 , Incorrect 

8, Social 

9> Good Self 

10 > Bad Self 



Categories Total 

\. Explain 

2> Model 

3 . Good 

4o Bad 

5, Social 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX}^^ 

6, Correct 

7 c Incorrect 

8> Social 

9, Good Self . 



10, Bad Self 
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TEN CATEGORY 

SPEECH AND HEARING THERAPY 
SESSION SCORING FORM 



Clinician; 
Client ! 
Date! 



Category Counts 
Category # of Events % of Total 
1 


Category Counts 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


C linician 
Total 


Client 
Total 







Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 



Correct Response 6,7 

7 

Incorrect Response 6,7 

6/3 

Good Eval Ratio 6 

7/4 

Bad Eval Ratio 7 

8 



Inappro. Response 6,7,8 = 

8/1 f 2 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1—2—3—4—5—6—7—8—9 
1—2 — 3—4—5—6—7—8—9 
1—2—3—4-^5—6—7—8—9 



Comments: 
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TEN CATEGORY 

SPEECH AND HEARING THERAPY 
SESSION SCORING FORM 



Clinician! 
Client: 
Date: 



Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Category Counts 
Category # of Events % of Total 
1 


Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


Clinician 
Total 


Client 
Total 







Ratio Scoring 
6 

Correct Response 6,7 

1 

Incorrect Response 6,7 

6/3 

Good Eval Ratio 6 

7/4 

Bad Eval Ratio 7 

8 



Inappro. Response 6,7,8 = 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Keasures 



No Yes 
1~2~3~4~5~6~7~8~9 
1~2~3~4~5~6~7— 8—9 
1~2~3~4~5~6~7~8~9 



Comments: 



TEN CATEGORY 

SPEECH AND HFARING THERAPY 
SESSION SCORING FORM 



Clinician J 
Client J 
Date: 



Category # of Events % of Total 
1 


Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


C linician 
Total 


Client 
Total 







Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 
6 



Correct Response 



6,7 

7 



Incorrect Response 6,7 

6/3 

Good Eval Ratio 6 

2/1 

Bad Eval Ratio 7 

8 



Inappro. Response 6,7,8 = 

8/1.2 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1~2~3~4~5~6"7— 8—9 
l — 2"3"4~5— 6—7—8—9 
1—2—3—4—5—6—7—8—9 



Comments: 
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TEN CATEGORY 

SPEECH AND HEARING THERAPY Clinician: 
SESSION SCORING FORM Client: 

Date: 



Cateqory Counts 
Category # of Events % of Total 
1 


Category Counts 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


C linician 
Total 


Client 
Total 







Sequence Counts Ratio Scoring 



Sequence # of Events 6 

Correct Response 6,7 = 

6/3 7 

7/4 Incorrect Response 6,7 = 

8/1,2 6/3 

Good Eval Ratio 6 = 

7/4 

Bad Eval Ratio 7 = 

8 

Inappro. Response 6^7,8 = 

8/1.2 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1„2~3— ^--5—6— 7--8— 9 
1— 2— 3~4--5— 6~7--8~9 
1~2~3~4— 5~6~7~8~9 



Comments: 
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TEN CATEGORY 

SPEECH AND HEARING THERAPY 
SESSION SCORING FORM 



Clinician! 
Client! 
Date! 



Category Counts 
Category # of Events % of Total 
1 


CatecrOlTv Poiirrh^; 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


Clinician 
Total 


Client 
Total 







Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 
6 



Correct Response 6,7 

7 

Incorrect Response 6,7 

6/3 

Good Eval Ratio 6 

7/4 

Bad Eval Ratio 7 

8 



Inappro. Response 6,7,8 = 

8/1.2 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
? — 2 — 3— 4 — 5~6~7~8~9 
1"2~3~4~5— 6~7~8~9 
1 — 2 — 3—4— 5~6~7~8~9 



Comments: 
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TEN CATEGORY 






SPEECH AND HEARING THERAPY 


Clinician: 




SESSION SCORING FORM 


Client : 






Date: 




Cateqory Counts 


Cateqory Counts 




Category # of Events % of Total 


Cateqory # of Events 


% of Total 


1 


6 




2 


7 


3 


8 


4 


9 


5 


10 


C linician 


Client 






Total 








SeQuence Counts 


Ratio scoring 




bequence or rjvenus 


6 






Correct Response 6,7 




D/ J 


7 




7 /d 


Incorrect Response 6,7 




o/i , 2 


6/3 






Good Eval Ratio 6 






7/4 






Bad Eval Ratio 7 






8 






Inappro. Response 6,7,8 






8/1,2 






Direct Control 8 






5+8 






Socialization Total 





Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1—2— 3~4~5~6— 7— 8—9 
1„2~3~4~5~6~7— 8—9 
1—2—3—4—5— 6—7—8—9 



Comments: 



1 

1 



TEN CATEGORY 

SPEECH AND HEARING THERAPY 
SESSION SCORING FORM 



Clinician; 
Client; 
Date; 



Category Counts 
Category # of Events % of Total 
1 


Catecfory Counts 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


Clinician 
Total 


Client 
Total 







Secfuence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 
6 

Correct Response 6,7 

7 

Incorrect Response 6,7 

6^3 

Good Eval Ratio 6 

7/4 

Bad Eval Ratio 7 

8 

Inappro. Response 6^7,8 

8/1.2 

Direct Control 8 

5+8 

Socialization 



Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1~2~3~4 — 5"6~7~8--9 
1~2~3~4~5~6~7~8~9 
1— 2~3~4~5~6~7~8~9 



CoiTunents: 
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TEN CATEGORY 

SPEECH AND HEARING THERAPY Clinician: 
SESSION SCORING FORM Client: 

Date: 



Category Counts 
Category # of Events % of Total 
1 


Category Counts 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


C linician 
Total 


Client 
Total 







Sequence Counts 

Sequerce # of Events 

6/3 

7/4 

8/1,2 



Ratio Scoring 
6 



Correct Response 


6,7 = 
7 


Incorrect Response 


6,7 = 




6/3 


Good Eval Ratio 


6 




2Zi 


Bad Eval Ratio 


7 




8 


Inappro. Response 


6,7,8 = 




8/1,2 


Direct Control 


8 




5+8 



Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1~2~3"4~5~6"7~8~9 
1„2~3~4~5"6~7— 8— 9 
1~2~3~4— 5~6~7"8— 9 



Comments: 



TEN CATEGORY 

SPEECH AND HEARING THERAPY 
SESSION SCORING FORM 



Clinician: 
Client: 
Date: 



Cateqorv Counts 
Category # of Events % of Total 
1 


Cateqory Counts 
Category # of Events % of Total 
6 


2 


7 


3 


8 


4 


9 


5 


10 


Clinician 
Total 


Client 
Total 







Sequence Counts 
Sequence # of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 
6 

Correct Response 6,7 

7 

Incorrect Response 6,7 

6/3 

Good Eval Ratio 6 

7/4 

Bad Eval Ratio 7 

8 



Inappro. Response 6,7,8 = 

8/1 f 2 

Direct Control 8 = 

5+8 

Socialization Total = 



Therapy Evaluation 

A Good Session 
Therapist Effective 
Client Effective Progress 
Client Effectiveness Measures 



No Yes 
1~2~3~4~5~6~7~8~9 
1~2~3~4— 5~6~7~8"9 
1~2~3~4~5~6~7"8~9 



Conunents: 



TEN CATEGORY SCORING SYSTEM 
Group Therapy 
Purpose of Category System 

The group therapy scoring system is based on the same 
ten categories used in analyzing individual therapy. Since 
much of the speech and hearing therapy provided children is 
in groups, it became desirable to adapt the individual 
scoring system for application with groups. The group 
scoring system allows the clinician to quantify the kind of 
events and secjuence of events which occur in the therapy 
group. The clinician can determine by analyzing a segment 
of his group therapy the relative talking time of clinician 
and clients, the relative talking time of individual clients 
compared with one another, identify those children who 
pro\ ide others with teaching models and explanations, deter- 
mine the kind and amount of reinforcement children give one 
another, determine the number of correct and incorrect 
responses of each group member, and provide data specific 
to the amount of group socialization. Field testing of the 
group therapy scoring system has found it to provide the 
clinician much useful information about his group therapy. 



procedures for Using the Group Ten Category Syste m 

In order to apply group therapy analyses, the clini- 
cian must make either an audiotape or videotape recording 
of his therapy. He then selects a five minute segment 
(or longer if he wishes) from the total therapy session for 
analysis. The specific steps for applying the system for 
group therapy analysis are as follows: 

1. The clinician records, using either audiotape or 
videotape, most of the therapy session. With 
videotape, care should be taken to place the 
camera so that each member of the group, includ- 
ing the clinician, is readily visible. 

2. The clinician (and/or the supervisor) selects 
five minutes from the total session. It is often 
most useful to select that portion of therapy 
which the clinician wants to study, i.e., studying 
that section of the session where the clinician 
might feel he had difficulty in controlling the 
group. The matrix scoring of that therapy seg- 
ment might provide real insights as to what con- 
tributed to his "difficulty'*. 

3. The first playback of the therapy segment is with- 
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out stopping. On the second playback, the therapy 
is scored with the group ten category system. 
Stopping and rewinding, looking at sequences over 
again, should be done whenever necessary. Group 
therapy scoring takes slightly longer than indi- 
vidual therapy scoring because simultaneous be- 
haviors of all group members are scorable. While 
one feature of this group scoring method is that 
it allov7s for the scoring of behaviors which occur 
simultaneously, it does require more time. The 
typical scoring time for a five minute group seg- 
ment would be 10 minutes. 

4. Segip.ent scores are then totaled and summarized on 
the group session scoring form, both for the total 
group session and for each group member individually. 
The average length of time for determining and re- 
cording data on the group is about 10 minutes. 

5. Total scoring time in using the group scoring 
analysis is approximately 25 minutes (five minute 
playback, 10 minutes scoring the second playback, 
and 10 minutes of summary scoring) . 

Group Ten Category Descriptions 

Vfhile the category descriptions for group scoring are 
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the same basic categories used in individual therapy scor- 
ing, there is one basic difference. That is, in group 
analysis we do not use five categories for clinician be- 
havior and five categories for the client; instead, all 
members of the therapy group may do any of the category 
behaviors; for example, one of the clients in the groups 
may provide other group members both instruction and rein- 
forcement. In good group therapy, the "teachers" are often 
the children in the group. 
Group Ten Category Descriptions 

Category 1 Explain, Describe Clinician or client de- 
scribes and explains the 
specific goals or pro- 
cedures of the session. 



Category 2 Model, Instruction 



Category 3 Good Evaluative 



Clinician or client spe- 
cifies clients behavior 
by direct modeling or by 
specific request. 
Clinician or client eval- 
uates client response and 
indicates a verbal or non- 
verbal approval. 



Category 4 , Bad Evaluative 



Category 5 Neutral -Social 



Category 6 Correct Response 



Category 7 Incorrect Response 



Category 8 Inappropriate- 
Social 



Category 9 Good Self-Evaluative 
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Clinician or client eval- 
uates client response as 
incorrect and gives a ver- 
bal or nonverbal disappro- 
val . 

Clinician engages in be- 
havior which is not thera- 
py goal oriented. 
Client makes a response 
which is correct for 
clinician instruction 
or model. 

Client makes incorrect 
response to clinician 
instruction or model. 
Client makes response 
which is not appropriate 
for session goals. 
Client indicates aware- 
ness of his own correct 
response. 
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Category 10 Bad Self-Evaluative Client indicates aware- 
ness of his own incor- 
rect response . 
Sample Transcript Using Group Ten Categories 

This transcript was taken directly from a three child- 
ren articulation group. The clinician is designated as T; 
Bob is A; Helen is B; and Fred is C. The categories are 
designated on the left margin. The clinician (T) or child 
designation (A,B,C) is made followed by the dialogue. 



Categories 
1 
6 
3,1 

7,10.6 



6 
3,1 



By Whom 
T-Clinician 
A-Bob 

T-Clinician 
A-Bob 

T-Clinician 

B -Helen 
T-Clinician 



Dialogue 
What is your sound. Bob? 
sssssss. 

Good. Can you think of a 
word that has that sound? 
Thoup. (Shakes head) . No, 
soup. 

Very good. What is your 
sound , Helen? rrrrr . 
rrrrrrrrr . 

Very good. Can you think 
of a word that begins with 
that sound? 



7 B-Heien 

1 T-Clinician 

4.1 C-Pred 

7 B-Helen 

4.2 C-Pred 

2 T-Clinician 

7,10 B-Helen 

4,2 T-Clinician 

6 C-Pred 

8 A-Bob 
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Wed? 

Pred, you have the same 
sound as Helen. Did she 
say her word correctly? 
No. It's red, not wed. 
Wed. 

No, you don't know how to 
make it good. I say, 
"rrrrrred. " 

Helen, you give us a word 
that has your sound in it, 
and we'll have Pred say a 
sentence using your word. 
Wead. (Shakes head, nega- 
tively) . 

No, Helen wants to say 
"read". Let us hear you, 
Pred, use "read" in a 
sentence. 

I read a story everyday. 
I read a lot of books 
about the Indians. 



T-Clinician 

A-Bob 

B-Helen 

T-Clinician 
A-Bob 

C-Fred 
T-Clinician 

C-Fred 

T-Clinician 

B-Helen 

T-Clinician 

A-Bob 
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I like to read a lot of 

Indian books, too. 

Yeah, they lived in tents 

and ate dog meat, 

Icky. That makes me sick, 

I wead betta books than 

that. 

Did Helen make any sounds 
wrong when she was talking? 
(Speaks simultaneously with 
clinician above) . They did 
a lot of other stuff, too. 
She said "wead". 
That's right, Fred. How 
should we say that word? 
rrrread. 

No, Helen, say "read". 
Read. (smiles at her 
success) 

Bob, say "read" as fast as 
you can five times. 
Read, read, read, read, 
read five Indian books. 
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3,8 



6,7 

4 
8 



8 



T-Clinician 
B-Helen 

T-Clinician 



C-Fred 

A-Bob 
B-Helen 

T-Clinician 



C-Fred 
A-Bob 

T-Clinician 
A-Bob 



How did Bob do, Helen? 
He was good and he was 
silly 

Let's hear Fred say 

rabbit" as fast as he can 
for five times. 
Rabb it , r abb i t , r abb i t , 
wabbit, wabbit. 
He got off wrong. 
I've got to get back there 
(to class) . 

Well, let's listen a little 
more to one another before 
we all go. 

(More slowly) . Rabbit, rab- 
bit, rabbit, rabbit, rabbit. 
That's good. 

Helen, what do you think? 
(No response) . 
Helen is just like the 
Indians • 
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5 T-Clinician You and all your talk 

about the Indians. Who 
do you think you are. 
General Custer? 

Scoring Practice 

The group ten category scoring form is scored differ- 
ently than the individual scoring form. The ten categories 
comprise the ten rows of the form. Whenever one of the 
four group participants (T^ A, C) performs a category^ 
his alphabet name is marked beside the appropriate cate- 
gory in the column for that event. Events move sequentially 
from left to right on the form. In the transcript above 
the first event was a category #1 by T (clinician) ; the 
second event was a #6 by A (Bob); etc. If two or more 
events happen at the same time (simultaneously) each event 
is marked in the same column. Follow the sample transcript 
above and see how it was scored on the group scoring form 
on the following page. 

Each event in the therapy session is scored sequenti- 
ally from left to right. The clinician performed the first 
event and a T is placed in the first column in the category 
#1 row (Explain) ; the second event of the session is per- 
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) 

J 

) 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 




.0 Bad Self 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 
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formed by A as category #6 (Correct) ; the next column, the 
third event, is a #3 (Good) performed by T (Clinician); the 
fourth column or event is by T and is a #1 (Explain) ; etc. 
You will note that in the above narrative there was only 
one place where the clinician (T) and Bob (A) spoke both 
at the same time; such simultaneous behaviors are listed 
in the same column. In this scoring example, we have 
placed an asterisk (*) above the colvmin which illustrates 
two simultaneous events. The totals for each group member 
are made in the right column of the form for each of the 
ten categories. The information obtained on the scoring 
form is then transferred to the Group Session Scoring Form. 

Practice scoring the sample transcript again. This 
time mask out our category assignments in the left column 
and score the events as they occur directly on the group 
scoring form on the following page. 
Sample Scoring Transcripts 

Before we go on and present other procedures rela- 
tive to the scoring of group therapy, let us practice 
once again the category scoring of some sample group 
therapy transcripts. For each of the two samples described 
below, see if you can find the correct category for each 
event, marking the transcript in the left hand column 



) 

J 

t 

) 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 




.0 Bad Self 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 
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Sample Group Therapy Transcript A 
Clinician (T) 

David (A), Down's syndrome child 

Cindy (B) , Down's syndrome child 

Yo YO (C) , Cerebral palsied child, mild 

mental retardation 
Categories By Whom Dialogue 

T (Holding up a picture) . What is 

this? What do you see? 

A (Incorrectly answers). Gum. 

T David, that's not gum. 

A I o. (I know) . 

T Cindy, you tell him, "I know." 

B I know. 

A I know. 

T (The clinician gives A and B a 

token) • 

O.K., Cindy, it's your turn. 

Pick out a picture that you like, 
Something to eat and we'll guess 
what it is. 
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B 

T 
A 



C 
B 



B 
T 

B 
T 



(Selects picture) . This is ice 

cream. (Wrong) . 

Cindy, that's not right. 

I know, I know. I think it's 

gum. (Correct) . 

Give two tokens to David (Gives 

him two tokens) . 

I want one. 

(Simultaneously with C) . Give me 
one. 

No, you two guys didn't guess. 
Now you can have a turn. (Holds 
up picture). O.K., what do you 

think? DO you think it's ? 

Candy. 

(Gives B one token). Right. I 

think it i s 

I think it is candy. 

(Gives B two tokens) . Yo Yo, what 

do you think it is. I think it is 



Cah — eee. (Incorrect) . 
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T You can do better than that, 

C (Grimaces a look of self-disap- 
proval) . Can eee. (Incorrect, 

but acceptable for his capability) . 

T (Gives Yo Yo one token) . I think 

it is candy. 

C I in it can — eee. (Laughing). 

T (Gives him two tokens) . Yo Yo, 

pick out a picture of a food that 
you like. Let us guess what it is. 

C (Reaches and picks picture of ham- 

burger) . I pick handugah. (In- 
correct) . 

T Cindy, tell Yo Yo how to say it. 
I think it ' s . 

B I think it is hamburger. 

T (Gives two tokens to B). 

C Me, handugah. Mine. (Reaches for 

tokens). Me, handugah. 

T (Holds tokens back from C) . No, 

no, Yo Yo. You didn't say, "ham- 
burger." 
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Sample Group Therapy Transcript B 
Clinician (T) 

Johnny (A) , working on f/th sxibstitution 

Susie (B) , working on f/th substitution 

Richard (C) , working on t/k substitution 



Categories By Vfliom 

T 



A 
T 
B 
T 



A 
T 

C 
T 



Dialogue 

I'm going to show you a card with 
a picture on it. You tell me what 
it is, Johnny? (Shows picture of 
a thumb) . 
Pum. 

Susie, was that good? 
N oooooooooo! 

Good, Susie. O.K., Johnny, try 
it again. Do it this way. (Makes 
an exaggerated tongue protrusion) . 
THumb. 
Fum. 

Richard, what do you think? Did 

that sound right to you? 

No. It's thiomb. 

That's right, Richard. Now, 
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Johnny, look in the mirror and 
do it this way. THuiiib. 
A Thumb. 

T Very good, Johnny. That's the 

way to do it. Remember, when you 
say the TH (makes pronou^ ;'ed tongue 
protrusion) that you put your 
tongue between your teeth. THumb. 
O.K., it's Richard's turn. Richard, 
tell me what this picture is. 
(Holds up picture of a kite) . 



C K tite. 

T That's pretty close, Richard. 

Try it again. 

C KKKKKKK tite. (Prolongs the k) . 

T How did you think that sounded, 

Richard? 
B It sounded very wrong. 

T Susie, it is Richard's turn to 

answer. Richard? 
C (Looking at Susie) . Well, I 



guess it wasn't very dood. 
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(Demonstrates a d/g substitution) . 

T Let's try it this way. K ite. 

C K-ite. 

T How was that? 

C That was o-tay. 

T That was o-Kay. 

C That was o-Tay. 

B (B laughs at C) . It's o-Tay. 

T Say o-Kay, Richard, 

C 0-Kay. 

T That's fine, Richard. Now it's 

Susie's turn. What's this a pic- 
ture of, Susie? (Shows bathtub). 

B That's a baTH-tub. 

T (Winks eye at B) . Johnny, did 

that sound correct to you? 

A Yes. 

T That's right, Johnny. Susie said 

baTHtub. That was very well done, 
Susie. Johnny, can you say that 
word like Susie can? 

A BaTHtub . 
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How <?id that sound to you, Richard? 
Johnny can say it better than she 
can. 

BaTHtub, baTHtub, baTHtub. 
There Susie said it well, didn't 
she? 

She just said it, that's all. 
Well, let's hear you say the word 
for this. (Shows picture of man 
baking a ham) . 
Ha-m. 

Let us say, "The man is baking 
the ham. " 

(Simultaneously with T above). 
I know what the word is. 
The man is bating the ham. 
(Laughs) . I never heard of "bat- 
ing. " 

Susie, why do you always like to 
laugh at other people's mistakes? 
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.0 Bad Self 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct j 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 




.0 Bad Self 


9 Good Self 


8 Social 


7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 


1 Explain 
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Data Analysis 

Our purpose in using videotape or audiotape playback 
of a segment of group therapy is so that we might know what 
is "going on" in the therapy session* An observer might, 
also, use the group therapy scoring method "live", scoring 
by direct observation* The data obtained in the Group 
Scoring Fo:nn is then transferred to the Group Session 
Scoring Form* 

On the Group Scoring Form we summarize the category 
counts for each group participant, including the clinician 
(T). On the scoring form sample, we see that there was a 
total of 57 events: 23 by T; 12 by A; 11 by B; and 11 by 
C. The percentages of behavioral categories is computed 
at the very right margin* in this example we see that 21 
percen of the session was devoted to explanations (with 
all but one explanation furnished by the clinician) . The 
therapy sequences required for determining the various 
ratios are listed in the middle of the left of the Group 
Session Scoring Form. The amount of clinician partici- 
pation is recorded here; in this segment, we see the 
clinician participated in about 40% of the session* On the 
middle right of the Scoring Form we see that therapy ratios 



Practice Group Session Scoring Forms 



GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: J9-r\<i' ^■ 

DATE: (>,+ /./^7« 



SUMMARIZATION TABLE 

Group Members 



A B C D E F T 
6/9 / 
7/10 / / 

5/8 5' v3 / 
Clinician % of Session^ ^0 u 





T 


A 


B 


c 


D 


£ 


F 


Total 


% of Session 


1 


// 






1 

/ 












• 21 


2 








/ 










7 




3 


H 


/ 


/ 














II 


4 


1 


/ 




3 










6 




5 


1 
















1 


,oX 


6 




3 


2 


6 










/o 


.11 


7 




I 


3 


1 












.oq 


8 




5' 


3 












? 


.H 


9 






I 












1 


.01 


10 




/ 


1 












X 


.o3 


Totals 


z$ /i 
Therapy 


Sequences 




T^ier 


apy Rating 



Group Effectiveness for 
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Clinician Rating of Session 
Comments: F(lct> Vcm.^otc. rf.c ^^'^p 



A B C D E F 
Correct Response 6 =75' io .i^ ~ 

6,7 

Incorrect Respons e 7 = (,0 /? - 

6,7 ' 

Socialization Total = - ,/6 - - ' 

Good Self Eval. 6/9 =- ,50 - - " 

6 

Bad Self Eval. 7/10= /• - - - 

7 

Group Leader 1,2,3,4= ,03 ,0i ,c/i ■ 

Total 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 
A 12345(1/7 
B 123^567 
C 123456^ 
D 1234567 
E 1234567 
F 1234567 

1 2 3 4 5 © 7 r*^*^- 
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are computed for each child member of the group; for ex- 
ample, we see that child A was correct 75% of the time and 
wrong 25% of the time; child B demonstrated only a 40% 
success rate; child C had the highest correct response ratio, 
meaning that he made a correct response when asked 83% 
of the time. The total time of the session spent in 
socialization (5 and 8) was only 16%, considerably lower 
than what is commonly observed. Child C was in charge of 
the group with his instructions, models and bad evalua- 
tives about nine percent of Jhe therapy time; the other 
children were much lower than this. At the bottom of the 
Group Session Scoring Form, the clinician has rated her 
session. We see that she rates child A as a six on a 
seven point rating scale relative to session effectiveness 
for that child; child B was a four; child C was a seven. 
Her overall pleasure with the session was rated as a six* 
Her comments, "Fred dominates group. Helen is behind in 
production tasks" are clearly substantiated by her scoring 
data. 

Clinician Tabulation Sheet for Group Therapy 

The data obtained from the Group Session Scoring Form 
could be tabulated Over time by adding it cumulatively to 
the Clinician Tabulation Sheet. Typical use of such tabu- 
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lation is shown on the sample sheet on the following page. 
While the Clinician Tabulation Sheet for Group Therapy has 
space for only four consecutive scoring sessions, these 
kind of data can be kept on a group, obviously, for a much 
longer time. Clear patterns of behavior emerge for the 
group over time. For example, if the above session which 
identified that child B (Helen) had only a 40% success rate 
in therapy was typical of Helen's success in other group 
sessions, we might conclude that this present group was 
too difficult for her. The advantage of the Tabulation 
Sheet is that it provides us data about our group over 
time. This will permit us to see the typical category 
responses of the clinician as well as each individual 
child. 

Utilization and Implications of the Group Ten Category System 

The advantage of scoring group speech and hearing 
therapy sessions is that it will provide the clinician or 
supervisor with much information about the group. For ex- 
ample, it will tell us about the relative participation 
in the group activities by the clinician and all the mem- 
bers of the group. By reviewing the Group Session Scoring 
Form, we can determine how each member participated, cate*- 
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gory by category. The correct and incorrect response ratios 
for each group member gives some index of the appropriate- 
ness (degree of difficulty, of interest) of the group 
activity. Determination of how much of the group activity 
was spent in socialization. Self evaluation ratios give 
information relative to how each group member judges his 
own success or lack of success. Group leader ratios 
identify those members who participate the most, the least, 
etc. The group effectiveness ratings enable the clinician 
to make judgments specific to the group's effectiveness for 
each member of the group, as Well as to make a determination 
of relative overall group effectiveness. 

If group scoring is done over time, such as scoring 
a group once weekly xor a period of a school semester, the 
clinician can clearly see behavior patterns for the group. 
This information might tell us, for example, that child B 
consistently does not seem to respond like the other 
group members. The clinician then might make the judgment 
whether to regroup child B in another group, or she may 
change the group activity to alter his performance, or 
she may decide that child B's "difference" is highly 
therapeutic and desirable for that child. Long term re- 
cording of group data on the Clinician Tabulation Sheet 



82 

for Group Therapy would enable the clinician to identify 
tjarticular typical response patterns for certain children; 
that is, if on one particular day the child's responses 
are quite dissimilar to his usual weekly performance, the 
atypical day could be studied for those factors which 
produced the poorer performance, be ignored or minimized, 
etc. Once again, the scorer should remember that group 
scoring only provides the measurements. What the measure- 
ments mean is up to the clinician. 

There is one final gain from group scoring, not re- 
lated to client performance. The scoring of one's group 
therapy seems to stimulate the clinician to become aware 
of his effects and the interactions of the group members, 
and to become aware of how each group member is performing. 
The scoring of group therapy, similar to the scoring of 
individual sessions, helps us become critical evaluators 
of the total therapy process, our own or someone else's. 
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0 Bad Self 


9 Good Self 
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7 Incorrect 


6 Correct 


5 Social 


4 Bad 


3 Good 


2 Model 
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9 Good Self 


8 Social 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE: 



SUMMARIZATION TABLE 
Group Members 



1 


■ T 




& 


C 


E) 


E 


















2 








- 








3 
















4 
















t: 
















6 
















7 
















8 
















9 
















10 
















Totals 


The] 
A B 


-apy 
C D 


Seq 
E F 


uenc 
T 


es 







6/9 

7/10 

5/8 

Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 

Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



ERIC 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 



Group Effectiveness for 



A 


1 


2 


3 


4 


5 


6 


7 


B 


1 


2 


3 


4 


5 


6 


7 


C 


1 


2 


3 


4 


5 


6 


7 


D 


1 


2 


3 


4 


5 


6 


7 


E 


1 


2 


3 


4 


5 


6 


7 


F 


1 


2 


3 


4 


5 


6 


7 


I 


1 


2 


3 


4 


5 


6 


7 



Comments: 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE; 



SUMMARIZATION TABLE 
Group Members 







~s- 


■ B 


C" 


TT" 


-E— 




1 
















2 
















3 
















4 
















5 
















6 
















7 
















8 
















9 
















10 

















Therapy Sequences 
A B C D E F T 



Totals 

6/9 

7/10 

5/8 



Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 



Good Self Eval 
Bad Self Eval. 
Group Leader 



6/9 = 
6 

7/10= 
7 

1>2,3,4= 

Total 



Group Effectiveness for 



Clinician Rating of Session 
Conunents: 



GROUP EFFECTIVENESS RATINGS; 

Bad Good 
A 1234567 
B 1 
C 1 

D 1234567 
E 1234567 
F 1234567 
1 2 3 4 5 6 7 



2 

2 3 4 5 6 7 
2 3 4 5 6 7 
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GROUP SESSION 
SCORING FORM 



Category 



SUMMARIZATION TABLE 
Group Members 





T 




B 


(I 


D 


E 


F 


1 
















2 
















3 
















A 
•» 
















5 
















6 
















7 
















8 
















9 
















10 

















Therapy Sequences 
A B C D E F T 



Totals 

6/9 

7/10 

5/8 



Clinician % of Session= 



CLINICIAN: 
DATE: 



Total % of Session 



Therapy Rating 

A B C D 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization 'I'otal = 



Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4 = 

Total 

GROUP EFFECTIVENESS RATINGS: 
Bad Good 
Group Effectiveness for A 1234567 

B 1234567 
C 1234567 
D 1234567 
E 1234567 
P 1234567 
Clinician Rating of Session 12 3 4 5 6 7 

Coininents: 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE: 



SUMMARIZATION TABLE 
Group Members 





T 


A 


B 


C 


D 


E 


F 


1 
















2 
















3 
















4 
















5 
















6 
















7 
















8 
















9 
















10 

















Therapy Sequences 
A B C D E F T 



Totals 

6/9 

7/10 

5/8 



Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 



Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



GROUP EFFECTIVENESS RATINGS: 



Group Effectiveness for 



A 
B 
C 
D 
E 
F 



Clinician Rating of Session 
Comments : 



Bad 
1 
1 
1 
1 
1 
1 
1 



4 
4 
4 
4 
4 
4 
4 



Good 

7 

7 

7 

7 

7 

7 

7 
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GROUP SESSION CLINICIANi 
SCORING FORM DATE: 

SXJMMARIZATION TABLE 



Category 



Group Members 



1 


T 




6 


C 


D 


E 


P 
















2 
















3 
















4 
















K 
J 
















6 
















7 
















8 
















9 
















10 
















Totals 


The] 
A B 


:apy 
C D 


Seqi 
E F 


aenc 
T 


es 







6/9 

7/10 

5/8 

Clinician % of Session= 



Total % of Session 



Therapy Rating 

ABC 

Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 



Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 

Group Effectiveness for A 1234567 

B 1234567 
C 1234567 
D 1234567 
E 1234567 
F 1234567 

Clinician Rating of Session 12 3 4 5 6 7 

Comments: 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE; 



SUMMARIZATION TABLE 
Group Members 



1 


■ T 


-5- 


6 
























2 
















3 
















4 
















C 

D 
















6 
















7 
















8 
















9 
















10 
















Totals 


The] 
A B 


rapy 
C D 


Seq 
E F 


uenc 
T 


es 







6/9 

7/10 

5/8 

Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 

6 = 



Correct Response 



6,7 



Incorrect Respons e 7 = 

6,7 

Socialization Total = 

Good Self Eval. 6/9 = 

6 

Bad Self Eval. ■ 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



ERIC 



GROUP EFFECTIVENESS RATINGS; 

Bad Good 



Group Effectiveness for 



A 


1 


2 


3 


4 


5 


6 


7 


B 


1 


2 


3 


4 


5 


6 


7 


C 


1 


2 


3 


4 


5 


6 


7 


D 


1 


2 


3 


4 


5 


6 


7 


E 


1 


2 


3 


4 


5 


6 


7 


F 


1 


2 


3 


4 


5 


6 


7 


I 


1 


2 


3 


4 


5 


6 


7 



comments: 



Practice Group Session Scoring Forms 



99 



GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE: 



SUMMARIZATION TABLE 
Group Members 







"S- 


■ B 






E 


7— 


1 
















2 
















3 
















4 
















5 
















6 
















7 
















8 
















9 
















10 

















Therapy Sequences 
A B C D E F T 



Totals 

6/9 

7/10 

5/8 



Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 

Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



Group Effectiveness for 



GROUP EFFECTIVEN3SS RATINGS: 
Bad Good 
3 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 



A 
B 
C 
D 
E 
F 



Clinician Rating of Session 
ERIC Comments : 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE: 



SUMMARIZATION TABLE 
Group Members 



1 






— !r~ 

o 


— TT- 






1 r 
















2 
















J 
































5 
















6 
















7 
















8 
















9 
















10 
















Totals 


The] 
A B 


-apy 
C D 


Seq 
E F 


uenc 
T 


es 





6/9 

7/10 

5/8 

Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 



6/9 = 
6 

7/10= 
7 

Group Leader 1,2,3,4= 



Good Self Eval 
Bad Self Eval. 



Total 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 



Group Effectiveness for 



Clinician Ratine; of Session 



A 


1 


2 


3 


4 


5 


6 


7 


B 


1 


2 


3 


4 


5 


6 


7 


C 


1 


2 


3 


4 


5 


6 


7 


D 


1 


2 


3 


4 


5 


6 


7 


E 


1 


2 


3 


4 


5 


6 


7 


F 


1 


2 


3 


4 


5 


6 


7 


I 


1 


2 


3 


4 


5 


6 


7 
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GROUP SESSION 
SCORING FORM 



Category 



CLINICIAN: 
DATE: 



SUMMARIZATION TABLE 
Group Members 



1 


1 




15 








t 
















2 
















3 
















A 
>* 
















5 
















6 
















7 
















8 
















9 
















10 
















Totals 


The] 
A B 


:apy 
C D 


Seq^ 
E F 


uenc 
T 


es 







6/9 

7/10 

5/8 

Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 

Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1, 2,3,4= 

Total 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 



Group Effectiveness for 



ERIC 



Clinician Rating of Session 
Comments: 



A 


1 


2 


3 


4 


5 


6 


7 


B 


1 


2 


3 


4 


5 


6 


7 


C 


1 


2 


3 


4 


5 


6 


7 


D 


1 


2 


3 


4 


5 


6 


7 


E 


1 


2 


3 


4 


5 


6 


7 


F 


1 


2 


3 
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5 
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2 


3 


4 


5 


6 


7 
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CLINICIAN: 
DATE! 



Category 



SUHMARIZATION TABLE 

Group Members 









"IT" 
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— IT" 


V 

£j 


"P 

i: 


J. 
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8 
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10 

















Therapy Sequences 
A B C D E F T 



Totals 

6/9 

7/10 

5/8 



Clinician % of Session= 



Total % of Session 



Therapy Rating 

A B C D E F 
Correct Response 6 = 

6,7 

Incorrect Respons e 7 = 

6,7 

Socialization Total = 



Good Self Eval. 6/9 = 

6 

Bad Self Eval. 7/10= 

7 

Group Leader 1,2,3,4= 

Total 



GROUP EFFECTIVENESS RATINGS: 
Bad Good 



Group Effectiveness for 



Clinician Rating of Session 
ERIC Conunents 



A 


1 


2 


3 


4 


5 


6 


7 


B 


1 


2 


3 


4 


5 


6 


7 


C 


1 


2 


3 


4 


5 


6 


7 


D 


1 


2 


3 


4 


5 


6 


7 


E 


1 


2 


3 


4 


5 


6 


7 


F 


1 


2 


3 


4 


5 


6 


7 


L 


1 


2 


3 


4 


5 


6 


7 



NINETEEN CATEGORY SCORING SYSTEM 
Individual Therapy 

Purpose of Category System 

The nineteen category system is designed for study- 
ing an individual speech and hearing therapy session. It 
is particularly useful for students studying the clinical 
process in therapy, enabling the student to specify the 
content and sequence of events within the session. While 
the nineteen category system is based on the same type of 
categorization as the ten category method of analysis, the 
larger system permits the specification of modality of 
model (spoken or written word) and whether responses and 
stimuli were verbal or nonverbal. The nineteen category 
system has been found applicable for scoring all kinds of 
individual therapy sessions (clients with problems of 
articulation, hearing, language, voice, and stuttering). 
Once the student has learned to score the ten category 
system, he can usually learn the nineteen category system 
easily. The obvious advai/uage of the nineteen category 
system is that it provides the scorer more information than 
does the ten category system. 
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Procedures for Using Nineteen Category System 

The nineteen category system has only been used under 
single confrontation conditions. The clinician records 
himself on either audio or videotape. He then selects 
randomly (or wherever he chooses) a five minute segment 
for scoring. Or the student studying various therapy pro- 
cedures may be provided a taped segment by his instructor. 
Perhaps he scores a tape of a master clinician or of his 
supervisor (the supervisor may be the master clinician) . 
Certain segments of the tape may be scored or the tape may 
be allowed to run in its entirety. The separate steps for 
using the nineteen category system are listed below, 
specified for the individual clinician desirous of scor- 
ing himself : 

1. The clinician records, using either audiotape or 
videotape, most of the therapy session. 

2. Five minutes are selected from the total session. 

3. The five minute segment is played back without 
stopping. It is then rewound and played back 
again. This second time it is scored. 

4. The clinician scores the playback using the nine- 
teen category system, stopping whenever required. 
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Scoring of a typical five minute therapy segment 
takes a total of about seven to eight minutes. 

5. Segment scores are then totaled and summarized 
on the Session Scoring Form and the various ses- 
sion ratios are computed and recorded on the form. 
Average length of time for determining and re- 
cording the data on the Session Scoring Form is 
about seven to eight minutes.' 

6. Similar to the ten category system, total scoring 
time is about twenty minutes (five minute play- 
back, seven or eight minutes scoring the second 
playback, and seven or eight minutes or summary 
scoring) . 

Nineteen Category Descriptions 

Category 1 Explain, Describe clinician describes 

and explains the speci- 
fic goals or procedures 
of the session. 

Category 2 Auditory Model clinician elicits 

client behavior by 
providing ins true t ion 
or a direct auditory 
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Category 3 



Category 4 



Category 5 



Category 6 



Category 7 



Visual Model 



Audi tor y-Vi su a] 
Model 



Good Evaluative, 
Tangible 



Good Evaluative, 
Social-Verbal 



Good Evaluative, 
Social-Nonverbal 



model. 

Clinician elicits 
client behavior by 
providing instruction 
or a direct visual 
model. 

Clinician elicits 
client behavior by 
providing instruction 
or a combined auditory 
and visual model. 
Clinician evaluates 
client responses and 
indicates approval by 
awarding a tangible 
item. 

Clinician evaluates 
client response and 
verbalizes approval. 
Clinician evaluates 
client response and 
indicates nonverbal 



Category 8 No Evaluation 



Category 9 Bad Evaluative, 

Tangible 



Category 10 Bad Evaluative, 

Social-Verbal 



Category 11 Bad Evaluative, 

Socia 1 -Nonverba 1 



Category 12 Neutral-Social 
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approval. 

Clinician makes no 
observable approval 
or disapproval. 
Clinician evaluates 
response and indicates 
disapproval by pro- 
viding tangible dis- 
approval. 

Clinician evaluates 
client responses and 
verbalizes his dis- 
approval. 

Clinician evaluates 
client response and 
provides his nonverbal 
disapproval. 
Clinician engages in 
behavior which is not 
therapy goal oriented. 



Category 13 Correct Response 



Client makes a res- 



Category 14 Incorrect Response, 

App r ox ima t i on 



Category 15 Incorrect Response 



Category 16 Inappropriate- 
Social 



Category 17 Good Self- 

Evaluative 



category 18 Bad Self- 

Evaluative 



Category 19 No Response 
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ponse which is cor- 
rect for clinician 
instruction or model. 
Client makes a response 
which is an approxima- 
tion of a correct re- 
sponse for clinician 
instruction or model. 
Client makes incorrect 
response to clinician 
instruction or model. 
Client makes response 
which is not appropri- 
ate for Session goals. 
Client indicates aware- 
ness of his own correct 
response. 

Client indicates aware- 
ness rf his own incor- 
rect response. 
Client does not 
respond, either ver- 
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bally or nonverbally, 
to clinician instruc- 
tion or model. 

Sample Transcript Using the Nineteen Categories 



Category # 


Speaker 


Dialogue 


2 


Clinician: 


Letter 


gun. 


14 


Chip: 


Litter 


gun. 


6,2 


Clinician: 


Good; 


again. 


•14 


Chip: 


Litter 


gun. Spider gun. 


1 


Clinician: 


How' s 


that? 


17,14 


Chip: 


Good. 


Suckas gun. 


2 


Clinician: 


Say that again. 


14 


Ch in* 


Suckas 


gun. 


2 


Clinician: 


Circus 


gun. 


13 


Chip: 


^ircus 


gun. 


6,2 


Clinician: 


Great. 


Say it again. 






two or 


three times. 


13 


Chip: 


Circus 


gun. Circus gun. 






Circus 


gun. 


4 


Clinician: 


(Flips 


to next picture 






couplet) . Say this. 






pear gun. 



13 Chip; 

6,4 Clinician : 

13 Chip: 

2 Clinician : 

13 Chip: 

1 Clinician : 

17 Chip: 

6,2 Clinician : 

13 Chip: 

1 Clinician : 

17 Chip: 

6,2 Clinician : 

15 Chip: 

1 Clinician : 

14 Chip: 



10^2 Clinician : 

13 Chip: 
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Pear gun. 

O.K., turn the page. 

Car moon. 

Car moon. 

Again. 

Car moon. 

How was ity 

Good. 

Pretty good; turn the 

page again. 

Car knife. 

How was that? 

Good. 

Perfect. Put five fingers 
down. 

Car gur (incorrect) . 
Think. 

Car knife, car knife, car 
knife, car knife slightly 
wrong) . 

No, try it again. 
Car knife, car knife. 



ERiC 



Clinician: 



13 



Chip: 



13 



6^ 



14 



18 



Clinician: 
Chip: 

Clinician: 
Chip: 

Clinician: 
Chip: 
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Good for you. Do you think 
you can put all my fingers 
up on that one? 
Spider knife, spider knife, 
spider knife, spider knife, 
spider knife. 
Try it again. 
Spider knife. 

Fine. O.K., turn the page. 
Car Fork (faulty). 
How v?as it? 
Not so good. 



Scoring Practice 

The therapy dialogue above has been scored using the 
nineteen category scoring form below: 



Categories 



Total 



1. Explain 












1 ^ 








6 


2. Auditory Model 
















































3. Visual Model 


















I 


■■tt 




























c 


4. Aud.-Vis. Model 




















-f-4 






i \ 


























Oh 






5 . Good, Tangible 


























! 




















r 














c 


6. Good, Verbal 


































































1 


7 . Good, Nonverbal 






















































c 


8. No Eval 
















li=: 








































9. Bad, Tangible 
















1 


























y 
i 








c 


10. Bad, Verbal 
















H — 
—\ — 
































/ 


11 . Bad, Nonverbal 


















































c 


12. Social 
















F 
t 




















1 
















c 
























1 
























1 

1 1 






13. Correct 












^ u« iJ 






























i 


? 


14 . Approximation 


























■ 


15 . Incorrect 










u 




/ 


16. Social 












c 


17. Good Self 













18. Bad Self 



" f 



19. No Response 
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AS was first noted in using the ten category system, 
the continuous line from one category to another aids in 
scoring the nineteen category system more accurately and 
quickly. Putting a dot or a X in each category row has 
been found to be a slower way of scoring. The continuous 
line helps you know "where you are" on the scoring form. 

Count the frequency of each category event by counting 
the number of times a category occurred. These summarized 
counts are then written on the right margin of the scoring 
sheet. Eventually, these totals will be sxammrized on the 
Session Scoring Form (page 124). Go over the preceding 
transcript again and see if you can mark the scoring form 
below to match our scoring form above. Mask out our scor- 
ing model while you attempt to score the nineteen category 



system by yourself. 
Categories ^ Total 



1. 


ExDlain 




2. 


Auditorv Model 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5, 


Good. Tancrible 




6. 


Good. Verbal 




7. 


Good . Nonverba 1 




8. 


No Eval 




9. 


Bad. Tangible 




10. 


Bad. Verbal 




11. 


Bad. Nonverbal 




12. 


Social 






13. 


Correct 




14. 


ADDroximation 




15. 


Incorrect 




16. 


Social 




17. 


Good Self 




18. 


Bad Self 
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NINETEEN CATEGORY SCORING FORM 



Categories Total 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-Vis, Model ; 



Good^ Tangible 



6, Good^ Verbal 



7 , Good , Non verba 1 



8, No Eval 



9, Bad^ Tangible 



10, Bad, Verbal 



11, Bad, Nonverbal 

12, Social 



13, Correct 



14. 


ADoroximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



If you scored the practice session correctly, you 
may already know the basic categorizations of the nine- 
teen category system. If your scores do not agree with 
ours, practice the scoring again on a Practice Scoring 
Form. 



NINETEEN CATEGORY SCORING FORM 



Cateqories 




1. 


Explain 




2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud.-Vis, Model 




5. 


Good* Tanqible 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad, Tanaible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 




12. 


Social 






13. 


Correct 




14. 


Approximation 




15. 


Incorrect 




16. 


Social 




17. 


Good Self 




18. 


Bad Self 




19. 


No Response 





While the nineteen category system follows the same 
general scoring categorizations of the ten category system, 
it is a little more difficult to use. With practice, how- 
ever, we have found that scorer reliability is about the 
same using either the ten or nineteen system. Whenever 
the scorer is in doubt specific to a particular category, 
he should make the arbitrary decision to place the behavror 
wherever he thinks it most belongs. An occiasional error 
in categorization is to oe expected. Furthermore, there 
is no absolute in categorizing The nineteen category 
system is particularly useful for studying the therapy 
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of someone else and you may never know for sure what the 
clinician's intentions were. You only classify what you 
see or hear. Classify the behavior as it appears to you. 
You will have enough data for a five minute segment of 
therapy that an occasional error in classifying will not 
seriously alter the overall session scoring. 

Included below are two more sample transcripts. The 
first transcript has been scored; mask out these categori- 
zations and practice your own scoring. The second tran- 
script has not been scored and is provided for your own 
practice. 



Sample Scoring Transcript #1 
Category Speaker 
1 Clinician: 



16 



16 



16 



Client: 

Clinician: 
Client: 
Clinician: 
Client: 



Dialogue 

That's a special one to start out 
the game with and a special one to 
end the game. O.K. Now: 
How come we can't see the special 
one? 

Cuz it's going to be a surprise. 
0 . IC. 

You don't know the game rules yet. 
Oh. 
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13 



13 



6xi 



13 



13 



13 



1,4 



Clinician: What does a snake sound like? 
Sssss. 

Client: Sssss, 

Clinician: Sssss, snake, that's right! 
Client: Ssss. 

Clinician: Ssss Snake, O.K. I want you to 
keep your teeth closed and feel 
where your tongue is. Move it 

back further back in your 

mouth real far. 

Client: ShSh. 

Clinician: Just pull it across the top of 
your mouth (model) and go like 
this (model) ; keep your teeth 
together . 

Client: Ssss. 

Cliiician: Ssss snake. 

Client: Ssss snake. 

Clinician: O.K. (unincelligible but sounded 
like... .a new sound) O.K. Look 
at me, I'll keep my teeth to- 
gether and hold my tongue way 
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back on the top of my mouth and 
go. • • • Sh« 

14 Client: Sh (slightly wrong) • 

10# 1/ 2 Clinician: No, put it back. Shou*-., shout. 

14 Client: Sh-nout, sh-out. 

6,2 Clinician: There! Go like this. Sh 

13 Client : Shout . 

6 Clinician: O.K. 

13 Client: Shout (loud) 

1 Clinician: Did you say it right? 

17 CI lent : Yeah . 

10#1,2 Clinician: No! You go like this. Shout, 

shout. 

13 Client : Shout . 

6 Clinician: All right. 

13 Client: Shout. 

1 Clinician: Could you do that again? 

16 Client: Noi 

1#4 Clinician: Let's seel Remember, look, sh. 

13 Client: Shout. 

1 Clinician: Let's listen, (turns on loop 

recorder. 
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2 


Recorder 2 


Shout • 




V« XXliX^XC&li • 


You trv it acrain-. 


14 


Clieni" • 


Sh - (distorted) 


10 


Clinician! 


No, 




Rer'OT'dpr' • 

X\iC*_^V</X M*^X • 


Sihout 


2 


Pi "i nician* 

X X A IX ^ X « 


Now vou trv it 


14 


Client • 


Shout . (distorted 1 


1 

X 


Clinic ian • 

S>* X XliX ^ XuX A • 


VOU ^av it ricrht 


18 


Clienl" • 

X X wA 1 i« • 


No. 


1 

X 


C1 inician* 

^••«XXAiX XuX a • 


Vou didn't*^ Tii<?ten acain 

X >^ ^ XVAA A k« • X 0 ^^A 1 KJL^ %JL ^A 1 


2 


Recorder : 


Shout. 


2 


Clinician: 


Sh. 


13 


Client: 


Shout. (Correct) 


1 


Clinician: 


Listen. 


2 


Recorder: 


Shout. 



Saunple Scoring Transcript #2 

Category Speaker Dialogue 

Clinician: VJhen you use a slightly higher 

pitch your voice sounds better. 
Client: I can't think about my voice when 

I'm trying to talk to people. 
Clinician: With a little practice using a 
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slightly higher pitch your voice 
will sound better to you. 

Client: If it isn't me, I can't use it 

no matter how good it sounds. 

Clinician: Now, remember, your voice doesn't 
sound that bad to anyone. You are 
only trying to use it in a way 
that won't take so much effort. 

Client: Yes, I know that. 

Clinician: There are several things we can 
do tc help us remember to use a 
slightly higher pitch. 
Takes out paper and draws a large 
upward pointing arrow.) 
See that. That points up, 
doesn't it? 

Clients (nods in agreement) 

Clinician: Now if we had an arrow like this 

every place you are, it might jast 
help you to remember to keep your 
pitch up. Where could we put some- 
thing like a little card with an 



Client: 



Clinicianj 



Client: 



Clinician: 



Client: 



Clinician: 



Client: 
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arrow on it to serve as a re- 
minder? 

I could use a reminder just about 
every place. 

Well, where could we put these 
reminders? 

I could put one on my notebook 
and one on my mirror at home 
(using a higher pitch) . That 
sounds pretty good, doesn't it? 
Your voice is absolutely clear 
at the higher pitch. 
(Using a falsetto) Maybe I ought 
to talk like this and let people 
wonder what ever happened to the 
old me. 

No, never bother talking like 
that. Just use your regular 
voice but at a slightly higher 
pitch. 

(Using a slightly higher pitch) 
Does this sound the way that it 



client: 



Clinician: 
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ought to be? 
Clinician: Right. Just keeping the voice a 
little higher is all ^ou have to 
remember. Now, about those re- 
minder arrows. Do you know what 
I want you to do? 
Put arrows around to remind me to 
keep my voice up? 
I'd get some three by five cards. 
Draw an arrow on them. Then fix 
the card on something so that the 
arrow is pointing up. Every time 
you then see the arrow, it will 
remind you to keep up your pitch 
level. 

I'd just draw an arrow like this. 
(He draws an arrow on the paper) . 
Like this? 

Clinician: Yes^ just about that size on a 

small card. 
Client: Where shall I put them? 

Clinician: Put about five cards around wherever 



Client: 



Client: 



Clinician I 



Client: 



Clinician: 



Client: 



Clinician: 



Client: 



Clinician: 
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you seem to be the most* 
Can you think of five places? 
Wt"l^ on the notebook for starters « 
Then on my mirror in my room. 
Should I put one on my bike? 
That might not be a bad place 
and . 

(Interrupting) I can put one on 
my desk and maybe one in the 
kitchen. 

You're using a lower pitch again 
and your voice gets hoarse. 
I sound bad whenever I get too 
low. I could put one in my dad's 
car. 

You decide where you want to put 
the arrows. The best places are 
places where you do a lot of talk- 
ing. 

Your voice sounds hoarst when you 

get in a low pitchy too. 

At least, I know better. Maybe 
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I better get some arrows out for 
me too. 

Client: Are you going to be here next 

week? 

Practice using the nineteen category system with other 
therapy observations. Additional Nineteen Categoiry Scoring 
Forms may be found on page 13 L 

Data Analyses 

The nineteen category system permits the detailed dis- 
section of speech and hearing therapy. We almost never use 
the nineteen category system "live". The complexities of 
the scoring require us to stop frequently the audio or 
videotape. The individual scoring forms are summarized and 
the data is transferred to the Nineteen Category Speech and 
Hearing Therapy Session Scoring Form, following the same 
procedures outlined for both the ten categcxy system, in- 
dividual ar'^ group. 

The data on the Nineteen Category Speech and Hearing 
Therapy Session Scoring Form is taken from the practice 
transcript for the client named Chip, pp. 109. The summary 
data (the frequency of occurrence for each of the nineteen 
categories) is summarized on the right hand margin of the 



NINETEEN CATEGORY SPEECH AND HEARING 
THERAPY SESSION SCORING FORM 



Clinician: tlih^ 
Client :C«/^ 

Date: g -j'l-^'' 



6 



Category Counts 
Category # of Events % 

1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 

Clinician 
Total 



of Total 
/J 

a 



o 



0 



XL 



Secnience Counts 
Sequence # of Events 

13/(5. 6, or 7) V 
14/(5, 6, or 7) / 
15/(9,10,11) /? 
16/(1, 2, 3, or 4) 



Category 
13 
14 
15 
16 
17 
18 
19 



Category Counts 
# of Events % of Total 

2_ 



o 



a 6 



o 



Client 
Total 



2JL 



Ratio Scoring 
13 



Correct Response 
Approximation 
Incorrect Response 
Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14,15"= ^ 

14 TT 
13,14,15 = C 

15 TT 
13,14,15 = / 



13,14/5,6,7 

13,14 = 6 
15/9.10,11 

15 = _Q_ 
16,19 = / 
13,14,15,16,19 
16/(1. 2. 3, or 4) 
16 = 0 
12,16 c> 
Total = O 



.0' 



^-0 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1—2— 3—4— 5— 6—6)— 8—9 
1— 2— 3—4— 5— C— 7— ^-9 
1—2— 3— 4— 5— 6— (3— 8— 9 



COMMENTS: AH MWr*-, ^'^^ fy'(^^ 
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Scoring Form. These siunmary data are then totaled under 
the Category Counts Column. We see^ for example^ that 
category 1^ Explain^ occurred six times in the total seg- 
ment; category 2, Auditory Models occurred ten times; 
category 13 occurred nine times; category 14^ six times; 
category 19^ zero or not at all. A total of 47 categories 
occurred r 27 by the clinician and 20 by the client. The 
Sequeiice Counts column will summarize particular sequences 
of events which will be utilized in the computation of 
various therapy ratios; for example^ category 13^ Correct 
Response, and category 14, Approximation, were followed 
five times by Good Evaluative Categories 5, 6, and 7; this 
means that the total of 15 correct responses (categories 
13 and 14) were followed by five good evaluatives for 33% 
of the time. 

The ratios under the Ratio Scoring Coltimn are computed 
by counting a specific behavior and dividing that behavior 
by a suiranary of several behaviors. For example, the first 
ratio shown is Correct Response. We find that a total of 
nine Correct Responses (category 13) occurred; this figure 
of nine is then divided by the total number of responses 
(categories 13, 14, 15); since there was a total of 16 re- 
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sponses we divide the nine by 16 and find that 56% of the 
client's responses are correct. Tlie other ratios are de- 
termined similarly as shovm on the Session Scoring Form* 

The individual clinician and/or his supervisor might 
want to keep track of the therapy events and ratios over 
time. If such continuous record is desired, the Clinician 
Tabulation Sheet is useful, permitting the continuous scor- 
ing of up to 16 successive session summaries. Similar to 
the Clinician Tabulation Sheet used for both the ten cate- 
gory systems is the Nineteen Category Clinician Tabulation 
Sheet. 

Utilization and Implications 

We might comment a moment on the Session Scoring Form 
which summarizes the therapy with Chip. Here we find that 
the clinician performs 57% of the time and the client 43%; 
this kind of percentage breakdown frequently typifies 
"good" therapy sessions. The client performed correctly 
56% of the time but also had 38% near approximations; this 
particular clinician during this segment of therapy ivas 
accepting approximations most of the time as correct. Per- 
haps approximations should not have been accepted by the 
clinician as correct since the boy was already enjoying 
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a relatively good success rate in his therapy. With the 
correct responses and approximation responses all judged 
as correct, the boy was correct 94% of the time. Our 
project data* (See Office of Education annual reports as 
listed in Bibliography) suggest that effective therapy 
seems to allow total correct response somewhere between 
60 and 80 per cent. However, perhaps for this therapy 
segment, the boy needed a high level of success. Remember, 
the ratio figures obtained only give us data. We must 
make the judgments whether a particular ratio level is 
desirable or undesirable. 

The clinician's comment on the therapy session was, 
"All work, no play." The complete absence of socialization 
and neutral responses yielding zero ratios in these areas 
well substantiate the clinician's statement. Whether this 
is desirable, however, would be the judgment of the 
clinician, his supervisor, or the students and instructor 
studying the therapy segment. At the bottom of the form we 
also note that the clinician rates various dimensions of 
therapy effectiveness. Some objective measures (such as 
counting the correct number of responses for a pre-deter- 
mined number of test stimuli) are added as quantitative data 
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characterizing the jparticular session. 

When the Session Scoring Form is completed^ the 
events of therapy have been categorized and the clinician's 
impressions and effectiveness measures have been recorded. 
The Session Scoring Form is analyzed in any way the scorer 
wishes to use it. He might be interested in the relative 
frequency of clinician events compared with client events. 
Or he may be particularly interested in particular se- 
quences of events within the therapy session. 

The nineteen category system provides detailed data 
regarding both the kind of events and the sequence of 
events which may be in speech and hearing therapy. Tlie 
ten category system (individual therapy) probably provides 
the clinician who did the therapy and his supervisors all 
they need for either self or external supervision. For the 
student of therapy # however # the nineteen category system 
provides more detailed information relative to the kind of 
stimuli presented and the kind of reinforcement used. We 
have foxind the nineteen category system useful in advanced 
seminars looking at the clinical process in speech and hearing 
therapy. The nineteen category system has been used in con- 
nection with timing the events of therapy and in relating 
its use to different kinds of problems such as language^ 



130 

hearing, articulation, voice, stuttering, etc. (See Prescott, 
1970 in Bibliography). Like the ten category systems, the 
scorer should remember the nineteen category system is only 
like a ruler, it measures the events of therapy. What the 
measurements may mean will be up to the scorer. 



NINETEEN CATEGORY SCORING FORM 



Categories 





ExDlain 






2. 


Auditory Model 






3. 


Visual Model 






4. 


Aud.-Vis. Model 






5. 


Good, Tanaible 






6. 


Good, Verbal 






7. 


Good, Nonverbal 






8. 


No Eval 






9. 


Bad. Tangible 






10. 


Bad, Verbal 






11. 


Bad. Nonverbal 






12. 


Social 








13. 


Correct 






14. 


ADor oxima t ion 






15. 


Incorrect 






16. 


Social 






17. 


Good Self 






18. 


Bad Self 






19. 


No Response 







NINETEEN CATEGORY SCORING FORM 

Cateqoriea 



1. 


Explain 




2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5. 


Good, Tanqible 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad, Tanqible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 





12. Social 



13. 


Correct 


14. 


Approximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 



19, No Response 
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NINETEEN CATEGORY SCORING FORM 

Categories 

1, Explain 

2, Auditory Model 

3, Visual ^AOdel 

4, Aud,-Vis, Model 

5, Good, Tangible 

6, Gcod, Verbal 

7, Good. Nonverbal 

8, NO Eval 

9, Bad, Tangible 

10, Bad, Verbal 

11, Bad, Nonverbal 

12, Social 



13, Correct . 

14, Approximation 

15, Incorrect 

16, Social 

17, Good Self 

18, Bad Self 

19, No Response 



NINETEEN CATEGORY SCORING rX)RM 

Categories 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-vis, Model 

5, Good^ Tangible 

6, Good, Verbal 

7 , Good , Nonverbal 

8, No Eval 

9, Bad, Tangible 

10, Bad, Verbal 

11 , Bad, Nonverbal 

12, Social 



13. 


Correct 


14. 


Approximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



NINETEEN CATEGORY SCORING FORM 



Categories Total 

1. Explain 



2. 


Auditory Model 


3. 


Visual Model 


4. 


Aud.-Vis. Model 


5. 


Good. Tanaible 


6. 


Good, Verbal 


7. 


Good. Nonverbal 


8. 


No Eval 


9. 


Bad. Tanaible 


10. 


Bad. Verbal 


11. 


Bad. Nonverbal 


12. 


Social 




13. 


Correct 


14. 


ADoroximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



NINETEEN CATEGORY SCORING FORM 
Categories ' Total 



1. Explain 



2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5. 


Good, Tangible 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad, Tangible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 




12. 


Social 






13. 


Correct 




14. 


Approximation 




15. 


Incorrect 




16. 


Social 




17. 


Good Self 




18. 


Bad Self 




19. 


No Response 





NINETEEN CATEGORY SCORING FORM 



1. 


Exol a in 


Total 


2. 


Audii'Or'v Mnr\f^^ 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5. 


Good, Tanaible 




6 . 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad, Tanaible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 




12. 


Social 






13. 


Correct 




14. 


ADDroximation 




15. 


Incorrect 




16. 


Social 




17, 


Good Self 




18. 


Bad Self 




19. 


No Response 






\ 

NINETEEN CATEGORY SCORING FORM 




Cateqories 


Total 


1. 


Explain 




2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5. 


Good , Tanqib le 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad, Tangible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 




12. 


Social 






13. 


Correct 




14. 


Approximation 




15. 


Incorrect 




16. 


Social 




17. 


Good Self 




18. 


Bad Self 





19. No Response 
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NINETEEN CATEGORY SCORING FORM 



Categories 



1 . 


Exnl ain 

AiJ^^ J- * ■ 






2. 


Aiidit"Oirv Mnr^pl 






3. 


Visual Model 






4. 


Aud.-Vis. Model 






5. 


Good, Tanaible 






6. 


Good, Verbal 






7. 


Good , Nonverbal 






8. 


No Eval 






9. 


Bad, Tanaible 






10. 


Bad, Verbal 






11. 


Bad , Nonverbal 






12. 


Social 








13. 


Correct 






14. 


Approximation 






15. 


Incorrect 






16. 


Social 






17. 


Good Self 






18. 


Bad Self 






19. 


No Response 







NINETEEN CATEGORY SCORING FORM 



C ategories 
1. Explain 



2. 


Auditory Model 


3. 


Visual Model 


4. 


Aud.-Vis. Model ^ 


5. 


Good, Tanqible 


6. 


Good, Verbal 


7. 


Good, Nonverbal 


8. 


No Eval 


9. 


Bad, Tanqible 


10. 


Bad, Verbal 


11. 


Bad, Nonverbal 



12. Social 



13. 


Correct 




Approximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 



18, Bad Self 



NINETEEN CATEGORY SCORING FORM 



Categories 

1. Explain 

2> Auditory Model 

3. Visual Model 

4. Aud.-Vis, Model 

5. Good^ Tangible 

6. Good/ Verbal 

7. Good. Nonverbal 

8. No Eval 

9. Bad/ Tangible 

10. Bad. Verbal 

11. Bad/ Nonverbal 

12. Social 



13 , Correct 

14 , Approximation 

15, Incorrect 

16, Social 

17, Good Self 

18, Bad Self 

19, No Response 



NINETEEN CATEGORY SCORING FORM 



Categories 


Total 


1. 


Explain 




2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud.-Vis. Model 




5. 


Good, Tanqible 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




9. 


Bad., Tanqible 




10. 


Bad, Verbal 




11. 


Bad, Nonverbal 




12. 


Social 






13. 


Correct 




14. 


Approximation 




15. 


Incorrect 




16. 


Social 




17. 


Good Self 




18. 


Bad Self 




19. 


No Response 





NINETEEN CATEGORY SCORING F0R!-1 



Categories 

1> Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,"Vis, Model 

5, Good. Tangible 

6 , Good^ Verbal 

7 , Good . Nonverba 1 

8, No Eval 

9, Bad, Tangible 
10- Bad. Verbal 

11 > Bad. Nonverbal 

12, Social 

13, Correct 

14, Approximation 

15, Incorrect 

16, Social 

17, Good Self 

18, Bad Self 

19, No Response 



NINETEEN CATEGORY SCORING FORM 

Categories / 

1> Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-Vis, Model 

5 , Good , Tangib le 

6, Good, Verbal 

7, Good. Nonverbal 

8, No Eval 

9, Bad. Tangible 

10, Bad, Verbal 

11, Bad, Nonverbal 

12, Social 



13, Correct ^ 

14, Approximation 

15, Incorrect 

16, Social 

17, Good Self 

18, Bad Self 

19, l>o Response 
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NINETEEN CATEGORY SCORING FORM 

Categories Total 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,"Vis, Model 

5, Good/ Tangible 

6, Goodi Verbal 

7, Good. Nonverbal 

8, No Eval 

9, Bad^ Tangible 

10. Bad. Verbal 

11 > Bad. Nonverbal 

12, Social 

13, Correct 

14, Approximation 

15, Incorrect 

16, Social 

17, Good Self 

18, Bad Self ~ 

19, No Response 



NINETEEN CATEGORY SCORING FORM 



Cateqories 


Total 


1. 


Explain 




2. 


Auditory Model 




3. 


Visual Model 




4. 


Aud,-Vis, Model 




5. 


Good, Tangible 




6. 


Good, Verbal 




7. 


Good, Nonverbal 




8. 


No Eval 




o 

• , 


Bad, lanqible 




10, 


Bad, Verbal 




11. 


Bad, Nonverbal 




12, 


Social 






13. 


Correct 




14, 


Approximation 




15. 


Incorrect 




16. 


Social 




1^, 


Good Self 




18. 


Bad Self 




19, 


No Response 





13? 



NINETEEN CATEGORY SCORING FORM 



Categories Total 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-Vis. Model 

5, Good^ Tangible 

6, Good^ Verbal 

7, Good. Nonverbal 

8, No Eval 

9, Bad. Tangible 

10. Bad. Verbal 

11. Bad. Nonverbal 

12. Social 



13, Correct 



14. 


ADprox ima t ion 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



NINETEEN CATEGORY SCORING FORM 

Categories ^ Total 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-Vis, Model 

5, Good, Tangible 

6, Good, Verbal 

7 , Good , Non ve rba 1 

8, NO Eval 

9, Bad/ Tangible 

10, Bad, Verbal 

11 > Bad, Nonverbal 

12, Social 



13, correct 



14. 


Approximation 


15. 


Incorrect 


16. 


Soc ia 1 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 
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NINETEEN CATEGORY SCORING FORM 



Categories Total 

1, Explain 

2, Auditory Model 

3, Visual Model 

4, Aud,-Vis, Model 

5, Goodf Tangible 

6, Good^ Verbal 

7 , Good . Nonverbal 

8, No Eval 

9, Bad, Tangible 

10, Bad, Verbal 

11, Bad, Nonverbal 

12, Social 



13, Correct 



14. 


ADoroximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



NINETEEN CATEGORY SCORING FORM 

Categories 



1. 


Explain 






2. 


Auditory Model 






3. 


Visual Model 






4. 


Aud.-Vis. Model 






5. 


Good, Tangible 






6. 


Good, Verbal 






7. 


Good, Nonverbal 






8. 


No Eval 






9. 


Bad, Tangible 






10. 


Bad, Verbal 






11. 


Bad, Nonverbal 







12, Social 



13. 


Correct 


14. 


Approximation 


15. 


Incorrect 


16. 


Social 


17. 


Good Self 


18. 


Bad Self 


19. 


No Response 



mi 





Clinician 


• 
• 


THFRAPV ^F^^QTHNT cnOPTMr' i?r\DM 
L nLjisnirJL oIjOOXUJM OL#^KXJ>IVj rUKTi 


Client 


• 
• 




Date 


• 
• 






Cateqory Counts 


wczuc^uxy ijvenus /o or iOtax 


Category 


# of Events % of Total 


1 


13 






14 






15 




A 
*r 


16 




c: 


17 






18 




7 


ly 




n 

o 






9 






10 




















Client 




Total 


Total 










Secfuence Counts 




Ratio Scoring 


Seauence # nf Rvpnt-c! 




13 


13/(5, 6, or 7) 


Correct Response 13,14,15 = 


14/(5, 6, or 7) 




14 


15/(9,10,11) 


Approximation 13,14,15 = 


16/(1, 2, 3, or 4) 




15 




Incorrect 


Response 13,14,15 = 






13,14/5,6,7 




Good Eval 


13,14 = 






15/9,10,11 




Bad Eval 


15 






16,19 = 




Inappropriate 13 , 14 , 15 , 16 , 19 






16/(1, 2, 3, or 4) 




Direct Control 16 = 






12,16 




Socialization Total = 


Therapy Evaluation 



No Yes 
A Good Session 1 — 2 — 3 — 4 — 5 — 6 — 7 — 8 — 9 

Therapist Effective 1 — 2 — 3 — 4 — 5 — 6 — 7 — 8 — 9 

Client Effective i — 2 — 3 — 4 — 5 — 6 — 7 — 8 — 9 

Client Effectiveness Measures = 



COMMENTS: 



Iii2 



NINETEEN CATEGORY SPEECH AND HEARING Clinician: 
THERAPY SESSION SCORING FORM Client: 

Date: 



Category Counts 






Categorv # of Events % of Total 






1 


13 




2 


14 




3 


15 




4 


16 




5 


17 




6 


18 




7 


19 




8 






9 






10 






11 






12 






Clinician 


Client 




Total 


Total 










Secruence Counts 




Ratio Scorinq 


Sequence # of Events 




13 


13/(5, 6, or 7) 


Correct Response 13,14,15 = 


14/(5, 6, or 7) 




14 


15/(9,10,11) 


Approximation 13,14,15 = 


16/(1,2, 3, or 4) 




15 




Incorrect 


Response 13,14,15 = 






13,14/5,6.7 




Good Eval 


13,14 = 






15/9,10,11 




Bad Eval 


15 






16,19 = 




Inappropriate 13 , 14 , 15 , 16 , 19 






16/(1, 2, 3, or 4) 




Direct Control 16 = 






12,16 




Socialization Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1~2~3— 4~5~6~7~8— 9 
1-^2-^3—4—5—6—7—8—9 
1—2—3—4—5—6 — 7—8—9 



COMMENTS: 



l43 



NINETEEN CATEGORY SPEECH AND HEARING 
THERAPY SESSION SCORING FORM 



Clinician: 
Client : 
Date: 



Category Counts 

Category # of Events % of Total 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

Clinician 

Total 



Category 
13 
14 
15 
16 
17 
18 
19 



Category Counts 
# of Events % of Total 



Client 
Total 



Sequence Counts 
Sequence # of Events 

13/(5, 6, or 7) 

14/(5, 6, or 7) 

15/(9,10,11) 

16/(1,2, 3, or 4) 



Ratio Scoring 
13. 

Correct Response 



Approximation 



13,14,15 = 
14 

13,14,15 = 
15 



Incorrect Response 13,14,15 =_ 

13,14/5,6,7" 



Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14 = 
15/9,10,11 
15 

16.19 = 



13,14,15,16,19 
16/(1, 2, 3. or 4) 

16 = 

12.16 
Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1—2—3— 4—5— 6—7—8—9 
1--2— 3— 4— 5— 6— 7--8— 9 
1—2—3—4—5—6—7—8—9 



COMMENTS: 



.ERIC 



NINETEEN CATEGORY SPEECH AND HEARING 
THERAPY SESSION SCORING FORM 



Clinician: 
Client : 
Date: 



Category Counts 
Category # of Events 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

Clinician 

Total 



% of Total 



Category 
13 
14 
15 
16 
17 
18 
19 



Category Counts 
# of Events % of Total 



Client 
Total 



Sequence Counts 
Sequence # of Events 

13/(5, 6, or 7) 

14/(5, 6, or 7) 

15/(9,10,11) 

16/(1, 2, 3, or 4) 



Ratio Scoring 
13 

Correct Response 



Approximation 



13,14,15 = 
14 

13,14,15 = 
15 



Incorrect Response 13,14,15 = 

13,14/5,6,7" 



Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14 = 
15/9,10,11 
15 

16,19 = 



13,14,15,16,19 
16/(1, 2. 3, or 4) 

16 = 

12.16 

Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective. 

Client Effectiveness Measures 



No Yes 
1—2— 3— 4— 5— 6—7— 8—9 
1—2— 3~4~5~6— 7—8— 9 
1—2— 3—4— 5— 6—7— 8—9 



COMMENTS: 



V6 



NINETEEN CATEGORY SPEECH AND HEARING Clinicians 
THERAPY SESSION SCORING FORM Client: 

Date: 



Category Counts 




Category Counts 


Category # of Events % of Total 


Category 


# of Events % of Total 


1 


13 




o 


14 




1 
J 


15 




A 

4 


16 






17 




D 


18 





"7 

/ 


]9 




o 

O 






Q 

y 






lU 






1 1 






12 






\^ xxnxcxan 


Client 




Total 


Total 










Com 1 on <^ o /^/^i i 4- o 




Ratio Scoring 


Sequence # of Events 




13 


13/(5, 6, or 7) 


Correct Response 13,14,15 = 


X**/ ^ J , D , ox / / 




14 


15/(9 10 ^^\ 


Approximation 13,14,15 = 


16/(1, 2. 3, or 4) 




15 




Incorrect 


Response 13,14,15 = 




Good Eval 


13,14/5,6,7 
13,14 = 




Bad Eval 


15/9,10,11 
15 

16,19 = 




Inappropriate 13, 14, 15, 16, 19 

16/(1, 2, 3, or 4) 
Direct Control 16 = 






12,16 




Socialization Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1—2— 3~4~5~6--7~8~9 
1-^2^-3—4— 5—6 — 7— 8— 9 
l-^2--3^-4— 5~6~7~8— 9 



COMMENTS: 



1U6 



NINETEEN CATEGORY SPEECH AND HEARING 
THERAPY SESSION SCORING FORM 



Clinician: 
Client: 
Date: 



Category Counts 
Category # of Events % of Total 



2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 

Clinician 
Total 



Category 
13 
14 
15 
16 
17 
18 
19 



Category Counts 
# of Events % of Total 



Client 
Total 



Sequence Counts 
Sequence # of Events 

13/(5, 6, or 7) 

14/(5, 6, or 7) 

15/(9,10,11) 

16/(1, 2, 3, or 4) 



Ratio Scoring 
13 

Correct Response 



Approximat ion 



13,14,15 = 
14 

13,14,15 = . 
15 

Incorrect Response 13,14,15 = 

13,14/5,6,7" 

Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14 = 
15/9,10,11 
15 

16,19 = 



13,14,15,16,19 
16/(1, 2, 3, or 4) 

16 = 

12,16 

Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Olient Effectiveness Measures 



No Yes 
1— 2— 3~4~5~6~7~8--9 
1—2— 3—4— 5~6~7— 8—9 
1—2—3—4—5—6—7—8—9 



COMMENTS: 



lii? 



NINETEEN CATEGORY SPEECH AND HEARING Clinician: 
THERAPY SESSION SCORING FORM Client: 

Date: 



Category Counts 
Category # of Events % of Total 
1 


Category Counts 
Category # of Events % of Total 
13 


2 


14 


3 


LD 


4 


16 


5 


17 


6 


18 


7 


19 


8 

9 
10 
11 

12 

Clinician 
Total 


Client 
Total 



Secfuence Counts 
Sequence # of Events 

13/(5, 6, or 7) 

14/(5, 6, or 7) 

15/(9,10,11) 

16/(1, 2, 3, or 4) 



Ratio Scoring 
13 

Correct Response 



Approximation 



13,14,15 = 
14 

13,14,15 = 
15 

Incorrect Response 13,14,15 = 

13,14/5,6,7" 



Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14 = 
15/9,10,11 
15 

16,19 = 



13,14,15,16,19 
16/(1, 2, 3. or 4 ) 

16 = 

12,16 
Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1— 2~3~4— 5—6— 7— 8— 9 
1--2— 3— 4~5~6~7— 8— 9 
1--2— 3—4— 5—6— 7— 8—9 



COMMENTS: 



NINETEEN CATEGORY SPEECH AND HEARING Clinician: 
THERAPY SESSION SCORING FORM Client: 

Date: 



Category counts 
Category # of Events % of Total 
1 


Category Counts 
Category # of Events % of Total 
13 


2 


14 


3 


15 


4 




5 


17 


6 


18 


7 


19 


8 

9 
10 
11 
12 

Clinician 
Total 


Client 
Total 






Secfuence Counts 
Sequence # Events 
13/(5, 6, or 7) 
]4/(5,6,or 7) 

15/(9,10.11) 
16/(1,2, 3, or 4) 

Therapy Evaluation 

No 

A Good Session 1 — 2 — 
Therapist Effective 1 — 2 — 
Client Eftective 1 — 2 — 


Ratio Scorinq 
13 

Correct Response 13,14,15 = 

14 

Approximation 13,14,15 = 

15 

Incorrect Response 13,14,15 = 

13,14/5,6,7 

Good Eval 13,14 = 

15/9,10,11 

Bad Eval 15 = 

16,19 = 

Inappropriate 13,14,15,16,19 

16/(1, 2, 3, or 4) 
Direct Control 16 = 

12,16 

Socialization Total = 

Yes 

3~4~5— 6— 7—8— 9 
3—4— 5—6— 7—8— 9 
3— 4— 5—6— 7--8~9 



Client Effectiveness Measures 



COMMENTS: 



NINETEEN CATEGORY SPEECH AND HEARING Clinician: 
THERAPY SESSION SCORING FORM Client: 

Date: 







Category Counts 




Category 


# of Events % of Total 


1 


1 J 




2 


1 d 




3 


1 S 

X ^ 




4 


xo 




5 


1 / 




6 


X sJ 




7 


19 




8 






9 






10 






11 






12 






Clinician 


Client 




Total 


Total 










Sequence Counts 




Ratio Scorinq 


Sequence # of Events 




13 


13/(5, 6, or 7) 


Correct Response 13,14,15 = 


14/(5, 6, or 7) 




14 


15/(9,10,11) 


Approximation 13,14,15 = 


16/(1, 2, 3, or 4) 




15 




Incorrect 


Response 13,14,15 = 






13,14/5,6,7 




Good Eval 


13,14 = 






15/9,10,11 




Bad Eval 


15 






16,19 = 




Inappropriate 13 , 14 , 15 , 16 , 19 






16/(1, 2, 3, or 4) 




Direct Control 16 = 






12,16 




Socialization Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 

1 — 2 — 3— 4—5— 6 — 7— 8—9 
1 — 2 — 3— 4— 5--6— 7 — 8— 9 
1—2—3—4—5—6 — 7—8—9 



COMMENTS: 
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NINETEEN CATEGORY SPEECH AND HEARING 
THERAPY SESSION SCORING FORM 



Clinician: 
Client : 
Date: 



Category Counts 
Category # of Events 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

Clinician 

Total 



% of Total 



Category 
13 
14 
15 
16 
17 
18 
19 



Category Counts 
# of Events % of Total 



Client 
Total 



Sequence Counts 
Sequence # of Events 

13/(5, 6, or 7) 

14/(5, 6, or 7) 

15/(9,10,11) 

16/(1, 2, 3, or 4) 



Ratio Scoring 
13 

Correct Response 



Approximation 



13,14,15 = 
14 

13,14,15 = 
15 



Incorrect Response 13,14,15 = 

13.14/5,6,7" 



Good Eval 
Bad Eval 
Inappropriate 
Direct Control 
Socialization 



13,14 = 
15/9,10,11 
15 

16,19 = 



13,14,15,16,19 
16/(1, 2, 3. or 4 ) 

16 = 

12.16 

Total = 



Therapy Evaluation 

A Good Session 

Therapist Effective 

Client Effective 

Client Effectiveness Measures 



No Yes 
1—2— 3—4— 5— 6— 7—8— 9 
1—2—3— 4—5— 6—7 — 8—9 
1— 2— 3— 4— 5--6— 7— 8— 9 



COMMENTS: 



ERiC 
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APPENDIX G 

"Content and Sequence Analyses of Speech and Hearing Therapy" 



CONTENT AND SEQUENCE ANALYSES OF SPEECH AND HEARING THERAPY 



DANIEL R. BOONE AND THOMAS) E. PRESCOTT* 

University of Denver 



BY usv of cither vidct)tapc or audiotape replay, it 
is possible for the speech and hearing clinician 
to analyze the content and sequence of events in his 
therapy. Through such taped playback, also, the clini- 
cian in training can study the therapy of master clini- 
cians, he can study various parameters of the clinical 
process, or he can confront himself and analyze his 
own therapy sessions. The experienced clinician can, 
by using a scoring instnnnent with playback, study 
his own interaction with his clients— clinician effects 
on client and client effects on clinician. 

A therapy-scoring instrument used with tape replay 
enables the supervisor to quantify the events and the 
sequence of events in therapy. While historically the 
field of speech patholog)' and audiology has placed 
its clinical focus on client pre- and postevaluation, 
little emphasis has been given to evaluating the exten- 
sive therapy process which lies between the pre- and 
posttesting of clients. 

Both videotape and audiotape confrontation have 
been found effective in training speech and hearing 
clinicians, when such student clinicians were in- 
structed in using some kind of scoring matrix to 
quantify the events of their therapy (Boone and 
Stech, 1970). A scoring system provides the student 
with a focused feedback, peniiitting him to analyze 
the specific events of his therapy (StoUer, 1967). By 
using a therapy scoring system, Stech' found it po.i'^ible 
for the clinician to determine the number of events 
he contributes to the session as opposed to the number 
of events performed by the client. More importantly, 
he can quantify the total clinician-client interaction of 
a session sample, determining client behaviors result- 
ing in part from what he says or does, as well as 
specifying his own responses to client behaviprs. Such 
content and sequence analysis systems for scoring 
two-person interactions have been developed and uti- 
lized by Bales (1950), Rabow (1965), Amidon and 
Flanders (1967), Carroll (1967), Barker and Wl^ght 
(1967), and Johnson (1969), who developed a 40- 
category system for analyzing speech therapy sessions. 

Prescott (1970) found in analyzing numerous ther- 
apy tapes, scored by the Stech and the Boone and 
Goldberg (1969) scoring methods, that the number of 
different events in therapy correlated highly with the 
total time of each event. The Prescott data show that 
timing of therapy events during the scoring of a 
therapy scission does not provide any more data to the 
scorer than the mere frequency summation of events. 



Using a scoring system for studying the events of 
therapy in the Speech and Hearing Center at the 
University of Denver, have found that the typical 
student clinician can learn to score his own sessions 
reliably after a relatively short training period of no 
more than two hours (live scoring results correlate 
0.9 with scoring of a panel of judges). 

The sample scoring system presented here is an 
example of a content and sequence analysis system for 
studying speech and hearing therapv. Other systems 
(Prescott, 1970; Johnson, 1969; and' Diedrich, 1970) 
basically employ similar systems of analyses, using 
category matrices to classify events m therapy. The 
category system described here was originally devel- 
oped by Stech and has been modified to fit the train- 
ing needs of the present authors. 

A 10-CATEGORY SYSTEM 

When a therapy session is studied by employing 
this system, each event of therapy can be placed into 
one of 10 categories. Each category and its definition 
are listed below: 



^E. L. Stech, personal communication (1968). 

•DANIEL R. BOONE, Ph.D., is Professor of Speech P?thol- 
ogy, and THOMAS E. PRESCOTT is an assistant professor at 
the University of Denver. 



Category 
Number 

1 Explain, 
Describe 



2 Model, 
Instruction 

3 Good 
Evaluative 



4 Bad 

Evaluative 



5 Neutral-Social 



6 Correct 
Response 

7 Incorrect 
Response 

8 Inappropriate- 
Social 

9 Good 
Self-Evaluative 

10 Bad 

Self-Evaluative 



Clinician describes and explains the 
specific goals or procedures of the 
session. 

Clinician specifies client behavior by 
direct modeling or by specific request. 

Clinician evaluates client response and 
indicates a verbal or nonverbal ap- 
proval. 

Clinician e\aluates client response as 
incorrect and gives a verbal or non- 
verbal disapproval. 

Clinician engages in behavior which 
is not therapy-goal oriented. 

Client makes a response which is cor- 
rect for clinician iastruction or model. 

Client makes incorrect response to 
chili J n instruction or model. 

Client makes response which is not 
appropriate for session goals. 

Client indicates awareness of his own 
correct response. 

Client indicates awareness of his own 
incorrect response. 
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PROCEDURES FOR USING CATEGORY SYSTEM 

An average of about 15% of a speech and hearing 
therapy session is lost with audiotape confrontation 
alone; that is, the scorer will miss about that percent- 
age of nonverbal events as compared with videotape 
scoring (Boone and Stech, 1970). Nevertheless, the 
practicality of using the audiotape recorder over the 
videotape recorder in many clinical settings, such as 
in the schools, makes audiotape confrontation a popu- 
lar device for self-supervision, or for the supervisor 
studying the clinician, alone or with that clinician. 
The following procedures for using either videotape 
or audiotape confrontation in self or external super- 
vision have been found to be highly workable: 

1. The clinieiaii /coords the middle 20 minutes of his 
therapy, using a videotape or audiotape recorder. 
Experience and investigation using these confron- 
tation devices have found that the first five minutes 
and the last five minutes of a half-hour therapy ses- 
sion are not particularly representative of the 
whole session. Our investigations (Boone and 
Goldberg, 1969) have also found that a five-min- 
ute segment, selected either randomly or specifical- 
ly because the clinician wishes to study a particular 
part of his therapy, will offer about as much infor- 
mation as scoring the total 20-minute segment. In 
any case, record approximately 20 minutes of 
therapy. 

2. Select for playback and study about a five- minute 
segment from the total 20-minute recording. This 
segment should be studied as soon after the ses- 
sion is completed as possible, particularly in self- 
confrontation. Whenever possible, playback should 
not be deferred more than one day from taping. 

3. The clinician views and hears or hears his total 
five-minute segment first with no attempt to SfX)re 
what he sees or hears. He then plays back the 
five-minute segment and scores the segment using 
a lO-category system analysis. An experienced scor- 
er can do this with a minimum of stop-starting of 
the playback. A typical scoring form is shown in 
Table 1, and its use is described under "Sample 
Transcript and Scoring." Scoring a typical five- 
minute segment takes a total of about seven to 
eight minutes. 

Table 1. A representation of the practice scoring form. 



Categories 

1. Explain 

2. Model 

3. Good 

4. Bad 

5. Social 

6. Correct 

7. Incorrect 

8. Social 

9. Good Self 
10. Bad Self 



Scoring 



JlJ 



Total 

8 
5 

- 2 

2 
2 
2 
2 
4 
1 
1 



4. The total number of events scored in the session 
and the particular sequences of events are then 
summarized on the speech and hearing therapy ses- 
sion scoring form, as shown in Table 2. This per- 
mits the clinician to deterr.iine, for example, how 
many of the therapy events he aid, how many the 
client did, and the client s percentage of correct 
responses. By computing a few ratios with his 
total number of events in particular categories he 
can find such information as the ratio of his good 
evaluative reinforcements, bad evaluative re- 
sponses, and socialization within session. The aver- 
age time for determining the summary data on the 
session scoring form is also about seven or eight 
minutes. 

5. The total time required for tape playback, scoring, 
and summary tabulation should not exceed 20 
minutes. 

SAMPLE TRANSCRIPT AND SCORING 

The authors have developed the following transcript 
of a brief section of a therapy session to illustrate the 
various scoring categories of our analysis system: 



Category 

Number Speaker 


Dialogue 


1 


Clinician 


Well, today, Biffie, we're going to go over 
our /r/ words. 


8 


Client 


We're going to go skiing over the weekend. 


1 


Clinician 


You 11 have a lot of time to practice your 
new /r/ sound up there. 


8 


Client 


We get to stay up until Monday morning. 
So I won't be here next week. 


5,1 


Clinician 


Let's talk about the ski trip when you get 
back. Today I want us to get some work in. 


8 


Client 


You never want to talk anymore. 


5 


Clinician 


We just don't have the time to talk so 
much, Bi£Re. 


8 


Client 


Your face looks all mad today. 


1 


Clinician 


BiiHe, well start saying our / r/ words no»<v. 
ril turn on the recorder and if we get a 
good one, we'll play it back and let you 
near it. 


2 


Recorder 


Rah, rah, rah. 


1 


Clinician 


Say the words after me, now, Biffie. I want 
lo hear diose /r/s coming through. 


2 


Recorder 


Rah, rah, rah. 


7 


Client 


Wah, wah, wah. 


4 


Clinician 


I don*t want "wahs." 


2 


Recorder 


Rah, rah, rah. 


7 


Client 


Wah, wah, wah, wah. 


4 


Clinician 


Nope. 

You're rounding your lips too much. 
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10 Client I nev*T could say it right. 

1,3 Clinician Did I hear you say "right"? That was a 
perfect /r/, BilEe. 

2 Say, "Right, right, right. " 

6 Client Right, right, right. 

9 Hey, how come that hi is so good? 

1 Clinician Let's hear that good Ixl again. 

2 Recorder Right, right, right. 
6 Client Right, right, right. 

3 Clinician Now you've got it just the way we want it. 

This hypothetical dialogue is scored using a 10-cate- 
gory system as seen in Table 1. A continuous line from 
one category to another has been demonstrated to be 
a faster method of scoring. The number of occur- 
rences for each category— each row— are then totaled 
and summarized on the right margin of the scoring 
form. These totals are then transferred to the session 
scoring form (Table 2). 



The continuous-scoring method enable*^ the scorer 
to count the number of individual categories occur- 
ring within that taped segment. The sequence of par- 
ticular categories can then be determined. These ses- 
sion summaries provide the clinician or his sMpervisor 
with quantification about the events of the session. 
The meaning of the values obtained must be related to 
factors such as the overall progress of the client, the 
dynamics of the particular session, and the goal of 
the session. The hypothetical therapy dialogue, as 
represented in the scoring in Table 1, is summarized 
in Table 2. Besides the data obtained from category 
analysis, note how the clinician rates the overall effec- 
tiveness of the session, of self, and of the client; note, 
also, how any subjective data— such as number of cor- 
rect articulations— adds information for the particular 
session. 

One can quickly note these observations about this 
particular therapy session. The clinician explained and 
modeled behavior for the client for 45? of the session; 
the clinician occupied 66% of the events of the session; 
the child experienced 50% success and 50% failure; 



Table 2. A representation of the speech and hearing therapy session scoring form. 



Clinician: Jane CJark 
Client: Biffie C. 
Date: 3-2-71 



Speech and Hearing Therapy Session Scoring Form 



Category Counts 29 



Category 
1 
2 
3 
4 
5 

Clinician Total 



No. of Events % of Total 



8 
_5_ 
2 

2^ 
'2 

19 



28 
17 
7 
7 
7 

66 



Category Counts 29 

Category No. of Events % of Total 

6 _2_ _J_ 

7 _2_ 

8 _4_ 14_ 

9 J_ 
10 J_ 

Client Total 10 34 



Sequence Counts 
Sequence No. of Events 



6/3 
7/4 
8/1,2 



Ratio Scoring 
Correct Response 

Incorrect Response 

Good Eval. Ratio 

Bad Eval. Ratio 

Inappro. Response 

Direct Control 

Socialization 



6.7 
7 

6.7 
6/3 
6 

7/4 
7 
8 

6.7.8 
8. 1.2 
8 

5 + 8 



0.50 

0.50 

0.50 

1.00 

0.50 

0.50 
0.21 



Total 



Therapu Evaluation 
A Good Session 
Clinician Effective 
Client Effective Progress 
Client Effective Measures 20 



No Yes 
l_2-3-4-5-6-7-8-9 
1-2-3-4-5-6-7-8-9 
1-2-3-4-5-6-7-8-9 



6 Correct 



Comments: Ghent was restless, difficult to control today. 
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socialization characterized 21% of the total session. 
The chnician let the child know 100% of the time when 
he was incorrecc; 50% of the child's total responses to 
direct requests were conversational and inappropriate 
to the goals of the session; 50% of the child's socializa- 
tions were followed by the clinicians directing the 
st»ssion. This total sample segment would run "live" 
about one minute. Therefore, in an actual scoring scis- 
sion of a five-minute segment, the scorer would prob- 
ably have four or five times the total number of events 
shown here. Increased category observations are han- 
dled, however, in the same manner. Value judgments, 
specific to what the category counts and sequences 
mean, must be applied to the values obtained. The 
scoring system is only a measurement tool which will 
enable a clinician to study a therapy session. It can 
make him aware of his behaviors and tell him what 
his clients do. How much of any one event or sequ'^'nce 
of events he wants to do in any one session, the clini- 
cian or his supervisor must determine. For example, in 
this therapy segment scored,* we might judge that the 
child should have enjoyed a slightly higher success 
rate. Maybe the task of saying, "Rah, rah, rah," was 
too diflBcult for the child or was inappropriate for his 
interest; for whatever reason, he was totally unable 
to do it. 

Using data from a base rate tabulation sheet (see 
Table 3), the clinician can graph, over time, the indi- 
vidual therapy sessions scored. Such a summary graph 
shows the changes in performance from session to ses- 
sion and over longer periods of time. 

This type of content and sequence analysis can make 
us aware as clinicians of what we are doing and what 
our clients are doing. If we think we have a good 
session, or a bad one for that matter, we should be 
able to quantify the events of the session and make 
some kind of quantitative determinant about session 
effectiveness. Through such an analysis, we can then 
determine some of the dimensions of our effectiveness. 
In the case of the hypothetical clinician described 
previously, we might speculate that the high number 
of eight category responses by the client indicates 
that for this particular task the child does not appear 
particularly motivated. Perhaps this lack of enthusiasm 
for the task is related to his high rate of failure (50% 
of his responses to session goals were incorrect), or 
perhaps his enthusiasms were focused on the coming 
ski trip. Such a scale cannot identify the "why" of the 
data responses, but it can describe what happened 
in the session. 

DISCUSSION 

Speech and hearing clinicians in every setting are 
being asked the question, "Do we know that what we 
do as clinicians does any good?" We usually validate 
our effectiveness by looking at pre- and posttest com- 
parisons. More recently, we have begun to take ther- 
apy baselines of specific client responses, and then 
throughout therapy we might make sequential plots 



Table 3. A tabular representation of part of the clinician 
base rate tabulation sheet. The complete form also iiicludcs 
Columns to the right for Sessions 2 through 16. 

lot tor Tabulated Tabulation, by Session 

Sew. 1 

% of Total No of Exents, 
bv Category 

Cat. 1 28 

2 IT 

3 7 

4 7 

5 7 

6 7 

8 H 

9 3 
10 :J 

% of Total No. of Exents 

Accounted for by Clinician 66 
% of Total No of Events 

Accounted for by Client 34 

Correct Response Ratio 0.50 

Incorrect Response Rati{) 0,50 

Good Evaluative Ratio 0.50 

Bad Evaluative Ratio 10 

Inappro. Response Ratio 0.50 

Direct Control Ratio 0.50 

Socialization Ratio 0.21 

Therapy Eval. Over Time - 

Session Quality Rating 3 

Clinician Effectiveness Rating 3 

Client Progress Rating 4 



of client responses to specific tasks, as well described 
by Shelton, Amdt, and Elbert (1967a, b). Or a mea- 
sure of therapy effectiveness may be determined by 
comparing severity ratings or judgments made after 
listening to pretherapy and posttherapy tape record- 
ings. While we are often convinced that our therapy 
has done some good— other listeners may lack the 
same conviction— we never know for sure just what 
we did or did not do in therapy which helped produce 
the desired change. Similarly, we recognize the work 
of the master clinician, and we can make judgments 
as to who is "good" and who is "poor," but the exact 
dimensions that helped us make these judgments are 
never clearly known. A category system, such as the 
content and sequence analyses procedures described 
here, can give us additional data about our therapy. 
To our present methods of testing, therapy procedures, 
keeping therapy logs, and conventional supervision, 
we can add some quantitative as^^ccts about our ther- 
apy. We can become more aware of what we do and 
of the effects of what we do. 

In three years of developmg and using several cate- 
gory systems with clinicians in a trainmg program, 
we are using our matrices to determine various dimen- 
sions of therapy. For example, our analyses have told 
us that experienced clinicians let their clients know 
when their responses are incorrect, providing the 
client a noticeably higher rate of "bad evaluatives"— 
punishment— than the new clinician does. Wc have 
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found that successful therapy is usually characterized 
by a 60 to 80^ client success rate, and that therapy 
must be designed so that our clients experience this 
percentage of correct responses. We have found that 
keeping track of our good evaluatives and bad evalua- 
tives makes us more powerful trainers; we vary our 
rate of reinforcement or the intensity of our reinforce- 
ment specific to the changes of the clients correct 
and incorrect response rate. Some of our therapy ses- 
sions are characterized by an unusual amount of 
social-neutral conversation— much Category 5 and 8 
behavior; sometimes this is desirable, and so)ne- 
times this amount of conversation is excessive and not 
consistent with the goals of the session. Whatever 
observation we make in our category and sequence 
counts, we find out what we are doing. The meaning 
of any measured value must be provided by the super- 
visor or the clinician himself. The scoring matrix is 
only like a ruler, a tool of measurement, the measure- 
ment itself may have little meaning. The meaning of 
the measurement itself may vary with such factors as 
the clinical philosophy of the clinician or the super- 
visor, or the individual dynamics of the session being 
studied. 

The question may be asked. Are there sequences 
of ehnical events that are unique to the different pa- 
rameters of communication disorder? This was an- 
swered in part by Prescott (1970), who utilized con- 
t(*nt and sequence analysis to describe speech therapy 
with clients in four communication disorders param- 
eters: articulation, voice, language, and prosody. While 
the number of subjects was too small to generalize 
to larger populations, these data suggested differences 
and similarities in the therapy sequences used relative 
to the individual parameters studied. Differences and 
similarities were also noted between experienced and 
student clinician performance. Data of this nature may 
one day aid us in making value judgments about 
"good" and "poor" therapy specific to clinical param- 
eters and the experience of the clinician. 

SUMMARY 

By use of eitlier videotape or audiotape replay, the 
speech and hearing clinician can analyze the content 
and sequence of events in therapy. Previous studies 
(Boone and Goldberg, 1969; Boone and Stech, 1970) 
have demonstrated videotape and audiotape confron- 
tation to be effective tools in training clinical per- 
sonnel. For analysis of speech and hearing therapy 



sessions, a lO-category system that allows for quan- 
tifiable description of the events contained in the ses- 
sion or sessions studied is described. Procedures for 
utilizing the scoring technique are outlmed. This type 
of content and sequence analysis can niake us aware 
as clinicians of what we are doing in therapy as well 
as what our clients are doing. 
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